Using seed: 15460 Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Begin to load lora modules > Loading lorahub/flan_t5_large-wmt16_translate_ro-en ... 0%| | 0/20 [00:00 Loading lorahub/flan_t5_large-anli_r2 ... 5%|▌ | 1/20 [00:00<00:14, 1.30it/s] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-gem_e2e_nlg ... 10%|█ | 2/20 [00:01<00:13, 1.31it/s] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-quartz_read_passage_below_choose ... 15%|█▌ | 3/20 [00:02<00:17, 1.03s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-wiki_qa_Decide_good_answer ... 20%|██ | 4/20 [00:04<00:17, 1.09s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-race_high_Select_the_best_answer_no_instructions_ ... 25%|██▌ | 5/20 [00:04<00:15, 1.03s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-app_reviews_convert_to_rating ... 30%|███ | 6/20 [00:05<00:13, 1.06it/s] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-glue_mnli ... 35%|███▌ | 7/20 [00:07<00:13, 1.06s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-sentiment140 ... 40%|████ | 8/20 [00:08<00:14, 1.18s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-quail_context_description_question_answer_id ... 45%|████▌ | 9/20 [00:09<00:11, 1.08s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-snli ... 50%|█████ | 10/20 [00:10<00:10, 1.10s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-dbpedia_14_pick_one_category_for_the_following_text ... 55%|█████▌ | 11/20 [00:11<00:10, 1.22s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-quac ... 60%|██████ | 12/20 [00:13<00:11, 1.40s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-quoref_What_Is_The_Answer ... 65%|██████▌ | 13/20 [00:14<00:08, 1.25s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-wiqa_what_might_be_the_last_step_of_the_process ... 70%|███████ | 14/20 [00:16<00:08, 1.39s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-super_glue_cb ... 75%|███████▌ | 15/20 [00:17<00:06, 1.34s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-quarel_heres_a_story ... 80%|████████ | 16/20 [00:18<00:05, 1.28s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-race_middle_Is_this_the_right_answer ... 85%|████████▌ | 17/20 [00:20<00:03, 1.31s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-adversarial_qa_dbidaf_answer_the_following_q ... 90%|█████████ | 18/20 [00:21<00:02, 1.23s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Loading lorahub/flan_t5_large-race_middle_Select_the_best_answer_generate_span_ ... 95%|█████████▌| 19/20 [00:22<00:01, 1.23s/it] Downloading (…)/adapter_config.json: 0%| | 0.00/411 [00:00 Begin to perform gradient-free optimization ... Launching 1 jobs with new suggestions Updating fitness with value 0.19794374704360962 39 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.19664074103037515 38 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.20196577151616416 37 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18949530760447184 36 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18646785974502564 35 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18851580699284873 34 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.17956692457199097 33 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18219556013743082 32 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18811706304550171 31 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18308404684066773 30 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.15466183026631675 29 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.13169783075650532 28 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.11195437947909037 27 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.14315053780873618 26 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.09870247999827067 25 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.09308040221532185 24 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08350652158260345 23 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.1701445213953654 22 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08785513858000438 21 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.18224913199742637 20 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.887497984568278 19 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.20113089762185843 18 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08463106314341227 17 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.179056189929146 16 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.07683334509531657 15 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.17642755043471342 14 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.06571920676354828 13 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.0742276668098602 12 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.05183583021748306 11 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.12994661993059228 10 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08364694323973731 9 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08870862409630972 8 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.08821432639038829 7 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.05691506158264563 6 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.05956370060788695 5 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.13098620907509662 4 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.06969356769947482 3 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.09138107303580391 2 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.061673278693635536 1 remaining budget and 0 running jobs Launching 1 jobs with new suggestions Updating fitness with value 0.045564029637715844 0 remaining budget and 0 running jobs The recommended weight set for the LoRA modules is: 0.4984: lorahub/flan_t5_large-wmt16_translate_ro-en -0.2598: lorahub/flan_t5_large-anli_r2 0.4774: lorahub/flan_t5_large-gem_e2e_nlg 1.0626: lorahub/flan_t5_large-quartz_read_passage_below_choose 0.0428: lorahub/flan_t5_large-wiki_qa_Decide_good_answer 0.4685: lorahub/flan_t5_large-race_high_Select_the_best_answer_no_instructions_ -0.0285: lorahub/flan_t5_large-app_reviews_convert_to_rating -0.0458: lorahub/flan_t5_large-glue_mnli -0.0571: lorahub/flan_t5_large-sentiment140 0.5707: lorahub/flan_t5_large-quail_context_description_question_answer_id 0.5296: lorahub/flan_t5_large-snli 0.3255: lorahub/flan_t5_large-dbpedia_14_pick_one_category_for_the_following_text -0.0600: lorahub/flan_t5_large-quac 0.5097: lorahub/flan_t5_large-quoref_What_Is_The_Answer 0.5041: lorahub/flan_t5_large-wiqa_what_might_be_the_last_step_of_the_process 0.5070: lorahub/flan_t5_large-super_glue_cb -0.1103: lorahub/flan_t5_large-quarel_heres_a_story -0.0032: lorahub/flan_t5_large-race_middle_Is_this_the_right_answer -0.0723: lorahub/flan_t5_large-adversarial_qa_dbidaf_answer_the_following_q 0.0988: lorahub/flan_t5_large-race_middle_Select_the_best_answer_generate_span_