nateraw / nous-hermes-llama2-awq

TheBloke/Nous-Hermes-Llama2-AWQ served with vLLM

  • Public
  • 7.2K runs
  • L40S
  • GitHub
Run with an API
Playground API Examples README Versions

Input

*string
Shift + Return to add a new line
integer

The maximum number of tokens the model should generate as output.

Default: 512

number

The value used to modulate the next token probabilities.

Default: 0.8

number

A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Default: 0.95

integer

The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).

Default: 50

number

Presence penalty

Default: 0

number

Frequency penalty

Default: 0

string
Shift + Return to add a new line

The template used to format the prompt. The input prompt is inserted into the template using the `{prompt}` placeholder.

Default: "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{prompt}\n\n### Response:"

Add a payment method to run this model.

Sign in with GitHub

By signing in, you agree to our
terms of service and privacy policy

Output

```python import praw def get_top_posts(reddit, subreddit): posts = reddit.subreddit(subreddit).top(limit=100) top_posts = [] for post in posts: if post.score >= 1000: top_posts.append(post) return top_posts def save_image_attachments(posts, image_dir): for post in posts: for comment in post.comments: if 'image' in comment.body.lower() or 'jpg' in comment.body.lower() or 'png' in comment.body.lower(): try: comment.crop((0, 0, 1080, 1920)) comment.download(os.path.join(image_dir, f"{post.id}-{comment.name}")) except Exception as e: print(f"Failed to download image for post {post.id}: {e}") if __name__ == "__main__": # Create PRAW client client_id, client_secret, user_agent = "your_client_id", "your_client_secret", "pic-downloader" reddit = praw.Reddit(client_id=client_id, client_secret=client_secret, user_agent=user_agent) # Get top 3 posts of all time from /r/pics and save the image attachments image_dir = "images" top_posts = get_top_posts(reddit, "pics") save_image_attachments(top_posts, image_dir) # Close PRAW client reddit.close() ``` Replace "your_client_id", "your_client_secret", and "pic-downloader" with your own PRAW client ID, client secret, and user agent string. This script will download the top 3 posts of all time from /r/pics and save their image attachments to a folder named "images" in the same directory as the script.
Generated in
Tweak itReport

This example was created by a different version, nateraw/nous-hermes-llama2-awq:c71045fd.

Run time and cost

This model runs on Nvidia L40S GPU hardware. We don't yet have enough runs of this model to provide performance information.