公共 LoRA adapter

Cloudflare 提供一些可立即用于微调推理的公共 LoRA adapter。您可以通过我们的 playground ↗ 立即试用。

公共 LoRA 的名称将为 cf-public-x，此前缀保留给 Cloudflare 使用。

名称	描述	兼容模型
cf-public-magicoder ↗	多语言编码任务	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`
cf-public-jigsaw-classification ↗	有毒评论分类	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`
cf-public-cnn-summarization ↗	文章摘要	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`

您也可以通过 API 调用列出这些公共 LoRA：

Required API token permissions

At least one of the following token permissions is required:

Workers AI Write
Workers AI Read

List Public Finetunesbash

curl "https://api.cloudflare.com/client/v4/accounts/$ACCOUNT_ID/ai/finetunes/public" \
	--request GET \
	--header "Authorization: Bearer $CLOUDFLARE_API_TOKEN"

使用公共 LoRA 运行推理

要使用公共 LoRA 运行推理，只需在请求中定义 LoRA 名称。

我们建议您使用 LoRA 训练时使用的 prompt template。您可以在上述每个 adapter 的 HuggingFace 仓库中找到。

cURL

curl https://api.cloudflare.com/client/v4/accounts/{account_id}/ai/run/@cf/mistral/mistral-7b-instruct-v0.1 \
  --header 'Authorization: Bearer {cf_token}' \
  --data '{
    "messages": [
      {
        "role": "user",
        "content": "Write a python program to check if a number is even or odd."
      }
    ],
    "lora": "cf-public-magicoder"
  }'

JavaScript

const answer = await env.AI.run("@cf/mistral/mistral-7b-instruct-v0.1", {
	stream: true,
	raw: true,
	messages: [
		{
			role: "user",
			content:
				"Summarize the following: Some newspapers, TV channels and well-known companies publish false news stories to fool people on 1 April. One of the earliest examples of this was in 1957 when a programme on the BBC, the UKs national TV channel, broadcast a report on how spaghetti grew on trees. The film showed a family in Switzerland collecting spaghetti from trees and many people were fooled into believing it, as in the 1950s British people didn't eat much pasta and many didn't know how it was made! Most British people wouldnt fall for the spaghetti trick today, but in 2008 the BBC managed to fool their audience again with their Miracles of Evolution trailer, which appeared to show some special penguins that had regained the ability to fly. Two major UK newspapers, The Daily Telegraph and the Daily Mirror, published the important story on their front pages.",
		},
	],
	lora: "cf-public-cnn-summarization",
});