nateraw / llama-2-70b-chat-awq

llama-2-70b-chat quantized with AWQ and served with vLLM

  • Public
  • 77 runs
  • L40S
  • GitHub
  • Paper
  • License

Input

*string
Shift + Return to add a new line
integer

The maximum number of tokens the model should generate as output.

Default: 512

number

The value used to modulate the next token probabilities.

Default: 0.8

number

A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Default: 0.95

integer

The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).

Default: 50

number

Presence penalty

Default: 1

Output

Title: Paw-some Dog Birthday Party Itinerary Introduction: Hello there! I'm thrilled to help you plan a fun-filled birthday party for your furry friend. As a responsible and caring assistant, I've created a comprehensive itinerary that ensures a safe, enjoyable, and memorable celebration for your dog. Please review the following schedule and feel free to adjust it according to your pup's unique needs and preferences. 1. Pre-Party Preparations: a. Decorations: Set the mood with colorful balloons, streamers, and a personalized banner with your dog's name and photo. b. Music: Play some upbeat tunes that your dog will enjoy, like "Happy" by Pharrell Williams or "Pup-Tastic" by The Animal Fair. c. Games and Activities: Plan some engaging games and activities that are suitable for your dog's age, breed, and energy level. Examples include doggy obstacle courses, fetch, and musical sits. d. Treats and Goodies: Prepare a variety of healthy treats and toys to reward your dog throughout the party. You can also set up a "Pup-Cake" station where guests can decorate their own doggy treats. 2. Welcome and Introduction (10:00 AM - 10:15 AM): a. Greet your guests and introduce your dog. b. Give a brief speech expressing your gratitude for your dog's unconditional love and loyalty. c. Encourage guests to interact with your dog and get acquainted. 3. First Activity: Musical Sits (10:15 AM - 10:30 AM): a. Play some upbeat music and have your dog sit on command. b. Gradually increase the distance between you and your dog to test their obedience. c. Offer treats and praise for successful attempts. 4. Second Activity: Doggy Obstacle Course (10:30 AM - 11:15 AM): a. Set up a simple obstacle course using items like tunnels, cones, and jumps. b. Guide your dog through the course, encouraging them to jump, run, and play. c. Cheer on your dog as they complete the course, and offer support when needed. 5. Third Activity: Fetch (11:15 AM - 11:30 AM): a. Choose your dog's favorite toy or fetch item. b. Play a game of fetch, encouraging your dog to run, jump, and catch. c. End the game with plenty of praise and treats for your dog's efforts. 6. Pup-Cake Decorating Station (11:30 AM - 12:00 PM): a. Provide plain doggy treats or cookies for guests to decorate. b. Offer various toppings, such as yogurt, peanut butter, and sprinkles. c. Encourage creativity and have fun decorating the treats together. 7. Lunchtime (12:00 PM - 1:00 PM): a. Serve a nutritious and delicious meal for your dog, such as a homemade dog food or a high-quality commercial brand. b. Offer plenty of fresh water and a special treat or two during the meal. 8. Fourth Activity: Trick Training (1:00 PM - 1:30 PM): a. Teach your dog a new trick, such as "shake," "stay," or "roll over." b. Use positive reinforcement techniques, like treats and praise, to encourage learning. c. Practice the trick together until your dog masters it. 9. Fifth Activity: Group Photo Shoot (1:30 PM - 2:00 PM): a. Gather all the guests and their dogs for a group photo shoot. b. Use fun props and backdrops to capture memorable moments. c. Share the photos on social media, tagging your friends and family. 10. Closing Ceremony (2:00 PM - 2:15 PM): a. Express your gratitude to your guests for attending your dog's birthday party. b. Share some closing remarks, highlighting the importance of animal companionship and the joy our furry friends bring
Generated in

Run time and cost

This model costs approximately $0.22 to run on Replicate, or 4 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.