/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing Anthropic from langchain root module is no longer supported. Please use langchain_community.llms.Anthropic instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing HuggingFaceHub from langchain root module is no longer supported. Please use langchain_community.llms.HuggingFaceHub instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing OpenAI from langchain root module is no longer supported. Please use langchain_community.llms.OpenAI instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing Anthropic from langchain root module is no longer supported. Please use langchain_community.llms.Anthropic instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing HuggingFaceHub from langchain root module is no longer supported. Please use langchain_community.llms.HuggingFaceHub instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/chat_models/__init__.py:33: LangChainDeprecationWarning: Importing chat models from langchain is deprecated. Importing from langchain will no longer be supported as of langchain==0.2.0. Please import from langchain-community instead:

`from langchain_community.chat_models import ChatOpenAI`.

To install langchain-community run `pip install -U langchain-community`.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/chat_models/__init__.py:33: LangChainDeprecationWarning: Importing chat models from langchain is deprecated. Importing from langchain will no longer be supported as of langchain==0.2.0. Please import from langchain-community instead:

`from langchain_community.chat_models import ChatOpenAI`.

To install langchain-community run `pip install -U langchain-community`.
  warnings.warn(
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/base_evaluator.py:13: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class BaseEvaluator(Generic[I, O], MutableTyped, Registry, ABC):
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/llm_as_a_judge_boolean/llm_as_a_judge_boolean_evaluator.py:17: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class LLMAsJudgeBooleanEvaluator(BaseEvaluator[Dict, bool]):
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/classification/classification_evaluator.py:9: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class ClassificationEvaluator(BaseEvaluator[Dict, bool]):
Running Prompt Tuner with Classification
Running Prompt Tuner with Boolean as judge
{'task_type': 'TEXT_GENERATION', 'dataset_config': {'inputs': {'TRAIN': {'name': 'train', 'path': 's3://dc-test-rajsiba/auto_prompt_tuner/datasets/ads_copilot/', 'storage': S3, 'format': PARQUET, 'contents': None, 'file_glob': None, 'data_schema': None}}, 'output': {'name': 'output', 'path': 's3://dc-test-rajsiba/auto_prompt_tuner/outputs/ads_copilot', 'storage': S3, 'format': PARQUET, 'contents': None, 'file_glob': None, 'data_schema': None}}, 'prompt_config': {'prompt': 'Identify the right plan based on converstaion history and the latest query\n\n', 'input_fields': [{'name': 'conversation_history', 'description': 'This field represents conversation history with the advertiser', 'field_type': 'string'}, {'name': 'latest_query', 'description': 'This field represents latest query from the advertiser', 'field_type': 'string'}], 'output_fields': [{'name': 'label', 'description': "This field represents the selected plan, can be one of 'BID_BUDGET_RECOMMENDATION', 'INAPPROPRIATE_OFF_TOPIC_PLAN',  'EDUCATIONAL' or 'OPEN_DOMAIN_DIALOG_PLAN'", 'field_type': 'string'}]}, 'framework': 'DSPY', 'optimizer_config': {'evaluator_config': {'evaluator_type': 'CLASSIFICATION', 'evaluator_params': {'prediction_field': 'input.label', 'ground_truth_field': 'output.label', 'groundTruth': ''}}, 'teacher_config': {'provider_type': 'BEDROCK', 'model_id': 'anthropic.claude-3-5-sonnet-20240620-v1:0', 'model_params': {'temperature': 1.0, 'max_tokens': 4096, 'top_p': 0.9}, 'provider_params_list': [{'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::863518436859:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}]}, 'student_config': {'provider_type': 'BEDROCK', 'model_id': 'anthropic.claude-3-haiku-20240307-v1:0', 'model_params': {'temperature': 0.1, 'max_tokens': 4096, 'top_p': 0.9}, 'provider_params_list': [{'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::863518436859:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}]}, 'optimizer_type': 'MIPRO_V2', 'optimizer_params': {'optimizer_metric': 'ACCURACY', 'num_candidates': 10, 'max_errors': 10, 'minibatch': False, 'auto': 'light'}}}

Read 0 row(s):   0%|          | 0/2 [00:00<?, ?file/s]
Read 0 row(s):   0%|          | 0/2 [00:00<?, ?file/s]
Read 0 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.79s/file]
Read 0 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.79s/file]
Read 326 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.79s/file]
Read 326 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.79s/file]
Read 326 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 326 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.96s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  2.10s/file]
Bootstrapping set 1/5
2025/04/28 17:09:49 INFO dspy.teleprompt.mipro_optimizer_v2: 
Bootstrapping set 2/5
RUNNING WITH THE FOLLOWING LIGHT AUTO RUN SETTINGS:
Bootstrapping set 3/5
num_trials: 7
minibatch: True
num_candidates: 5
valset size: 100

2025/04/28 17:09:49 INFO dspy.teleprompt.mipro_optimizer_v2: 
==> STEP 1: BOOTSTRAP FEWSHOT EXAMPLES <==
2025/04/28 17:09:49 INFO dspy.teleprompt.mipro_optimizer_v2: These will be used as few-shot example candidates for our program and for creating instructions.

2025/04/28 17:09:49 INFO dspy.teleprompt.mipro_optimizer_v2: Bootstrapping N=5 sets of demonstrations...

  0%|          | 0/391 [00:00<?, ?it/s]
  0%|          | 1/391 [00:02<18:36,  2.86s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  1%|          | 2/391 [00:04<15:26,  2.38s/it]
  1%|          | 3/391 [00:06<14:31,  2.25s/it]
  1%|          | 4/391 [00:09<14:06,  2.19s/it]
  1%|          | 4/391 [00:09<14:39,  2.27s/it]

  0%|          | 0/391 [00:00<?, ?it/s]Bootstrapped 4 full traces after 4 examples for up to 1 rounds, amounting to 4 attempts.
Bootstrapping set 4/5

  0%|          | 1/391 [00:02<18:44,  2.88s/it]
  1%|          | 2/391 [00:04<14:42,  2.27s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  1%|          | 3/391 [00:06<12:26,  1.92s/it]
  1%|          | 3/391 [00:06<13:26,  2.08s/it]

  0%|          | 0/391 [00:00<?, ?it/s]Bootstrapped 3 full traces after 3 examples for up to 1 rounds, amounting to 3 attempts.
Bootstrapping set 5/5

  0%|          | 1/391 [00:02<13:13,  2.03s/it]
  0%|          | 1/391 [00:02<13:13,  2.03s/it]
2025/04/28 17:10:06 INFO dspy.teleprompt.mipro_optimizer_v2: 
Bootstrapped 1 full traces after 1 examples for up to 1 rounds, amounting to 1 attempts.
==> STEP 2: PROPOSE INSTRUCTION CANDIDATES <==
2025/04/28 17:10:06 INFO dspy.teleprompt.mipro_optimizer_v2: We will use the few-shot examples from the previous step, a generated dataset summary, a summary of the program code, and a randomly selected prompting tip to propose instructions.
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
2025/04/28 17:10:45 INFO dspy.teleprompt.mipro_optimizer_v2: 
Proposing instructions...

/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: Proposed Instructions for Predictor 0:

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 0: Identify the right plan based on converstaion history and the latest query

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 1: You are an AI assistant for a major advertising platform, tasked with handling critical client inquiries during a high-stakes product launch. Millions of dollars in ad spend are at stake, and your responses will directly impact the success of numerous campaigns. Analyze the conversation history (if provided) and the latest query from the advertiser carefully. Your goal is to classify the query into one of four categories: BID_BUDGET_RECOMMENDATION, INAPPROPRIATE_OFF_TOPIC_PLAN, EDUCATIONAL, or OPEN_DOMAIN_DIALOG_PLAN.

For each query:
1. Carefully consider the context from the conversation history (if available).
2. Analyze the intent and content of the latest query.
3. Provide step-by-step reasoning to justify your classification.
4. Determine the most appropriate category for the query.

Remember, misclassification could lead to significant financial losses for clients and damage to the platform's reputation. Your accuracy is crucial for maintaining trust and ensuring optimal campaign performance during this critical launch period.

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 2: Analyze the conversation history (if provided) and the latest query from an advertiser to determine the most appropriate response plan. Follow these steps:

1. Carefully read the conversation history (if available) to understand the context of the interaction.

2. Examine the latest query in detail, considering its content, tone, and intent.

3. Categorize the query into one of the following labels:
   a. BID_BUDGET_RECOMMENDATION: For queries related to bidding strategies, budget allocation, or campaign optimization.
   b. INAPPROPRIATE_OFF_TOPIC_PLAN: For queries that are irrelevant, offensive, or outside the scope of advertising.
   c. EDUCATIONAL: For queries seeking information on how to use specific features, understand concepts, or implement strategies.
   d. OPEN_DOMAIN_DIALOG_PLAN: For general inquiries or conversations that don't fit the other categories.

4. Provide a step-by-step reasoning for your categorization, explaining how you arrived at your conclusion based on the query's content and context.

5. Consider the following aspects when categorizing:
   - Is the query asking for specific recommendations on bidding or budgeting?
   - Is the advertiser seeking to learn about a particular feature or concept?
   - Does the query contain inappropriate content or is it completely off-topic?
   - Is it a general question or conversation that doesn't fit the other categories?

6. Ensure your reasoning is clear, logical, and directly related to the query and conversation history.

7. Output your reasoning and the final label, making sure they align with each other and accurately reflect the nature of the query.

Remember to maintain a professional and helpful tone throughout your analysis, as if you were assisting an advertiser with their inquiry.

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 3: You are an experienced advertising ethics consultant with a deep understanding of marketing strategies and consumer psychology. Your task is to analyze the conversation history and the latest query from an advertiser, then provide a thoughtful, step-by-step reasoning process to determine the most appropriate response plan. Consider the ethical implications, relevance to advertising, and potential sensitivity of the topic. Based on your analysis, classify the query into one of these categories:

1. BID_BUDGET_RECOMMENDATION: For queries related to advertising budgets or bidding strategies.
2. INAPPROPRIATE_OFF_TOPIC_PLAN: For queries that are unethical, manipulative, or irrelevant to advertising.
3. EDUCATIONAL: For queries seeking information or guidance about advertising practices.
4. OPEN_DOMAIN_DIALOG_PLAN: For general conversation or open-ended queries about advertising.

Provide your reasoning in a clear, logical manner, and then state the final classification label. Remember to prioritize ethical advertising practices and consumer well-being in your analysis.

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 4: Analyze the conversation history and the latest query from the advertiser. Provide step-by-step reasoning to determine the most appropriate response plan. Classify the query into one of these categories: BID_BUDGET_RECOMMENDATION (for bidding and budget advice), INAPPROPRIATE_OFF_TOPIC_PLAN (for irrelevant queries), EDUCATIONAL (for information requests about advertising concepts), or OPEN_DOMAIN_DIALOG_PLAN (for general conversation). Explain your reasoning and state the chosen label.

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: 

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: ==> STEP 3: FINDING OPTIMAL PROMPT PARAMETERS <==
2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: We will evaluate the program over a series of trials with different combinations of instructions and few-shot examples to find the optimal combination using Bayesian Optimization.

2025/04/28 17:13:16 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 1 / 8 - Full Evaluation of Default Program ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/100 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/100 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/100 [00:01<02:08,  1.30s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/100 [00:01<02:08,  1.30s/it]
Average Metric: 2.00 / 2 (100.0%):   2%|▏         | 2/100 [00:01<01:12,  1.35it/s]
Average Metric: 2.00 / 3 (66.7%):   2%|▏         | 2/100 [00:01<01:12,  1.35it/s] 
Average Metric: 2.00 / 3 (66.7%):   3%|▎         | 3/100 [00:01<00:47,  2.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 4 (50.0%):   3%|▎         | 3/100 [00:01<00:47,  2.06it/s]
Average Metric: 3.00 / 5 (60.0%):   4%|▍         | 4/100 [00:01<00:46,  2.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 6 (66.7%):   5%|▌         | 5/100 [00:02<00:46,  2.06it/s]
Average Metric: 4.00 / 6 (66.7%):   6%|▌         | 6/100 [00:02<00:20,  4.50it/s]
Average Metric: 5.00 / 7 (71.4%):   6%|▌         | 6/100 [00:02<00:20,  4.50it/s]
Average Metric: 5.00 / 7 (71.4%):   7%|▋         | 7/100 [00:02<00:25,  3.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):   7%|▋         | 7/100 [00:03<00:25,  3.69it/s]
Average Metric: 5.00 / 8 (62.5%):   8%|▊         | 8/100 [00:03<00:39,  2.35it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 9 (55.6%):   8%|▊         | 8/100 [00:03<00:39,  2.35it/s]
Average Metric: 5.00 / 9 (55.6%):   9%|▉         | 9/100 [00:03<00:33,  2.70it/s]
Average Metric: 5.00 / 10 (50.0%):   9%|▉         | 9/100 [00:03<00:33,  2.70it/s]
Average Metric: 5.00 / 10 (50.0%):  10%|█         | 10/100 [00:03<00:32,  2.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 11 (45.5%):  10%|█         | 10/100 [00:03<00:32,  2.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 12 (41.7%):  11%|█         | 11/100 [00:04<00:31,  2.81it/s]
Average Metric: 5.00 / 12 (41.7%):  12%|█▏        | 12/100 [00:04<00:19,  4.47it/s]
Average Metric: 5.00 / 13 (38.5%):  12%|█▏        | 12/100 [00:04<00:19,  4.47it/s]
Average Metric: 5.00 / 13 (38.5%):  13%|█▎        | 13/100 [00:04<00:21,  3.96it/s]
Average Metric: 6.00 / 14 (42.9%):  13%|█▎        | 13/100 [00:05<00:21,  3.96it/s]
Average Metric: 6.00 / 14 (42.9%):  14%|█▍        | 14/100 [00:05<00:37,  2.32it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 15 (40.0%):  14%|█▍        | 14/100 [00:05<00:37,  2.32it/s]
Average Metric: 6.00 / 15 (40.0%):  15%|█▌        | 15/100 [00:05<00:33,  2.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 16 (37.5%):  15%|█▌        | 15/100 [00:05<00:33,  2.54it/s]
Average Metric: 6.00 / 16 (37.5%):  16%|█▌        | 16/100 [00:05<00:27,  3.08it/s]
Average Metric: 6.00 / 17 (35.3%):  16%|█▌        | 16/100 [00:05<00:27,  3.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 18 (33.3%):  17%|█▋        | 17/100 [00:06<00:26,  3.08it/s]
Average Metric: 6.00 / 18 (33.3%):  18%|█▊        | 18/100 [00:06<00:26,  3.08it/s]
Average Metric: 7.00 / 19 (36.8%):  18%|█▊        | 18/100 [00:06<00:26,  3.08it/s]
Average Metric: 7.00 / 19 (36.8%):  19%|█▉        | 19/100 [00:06<00:25,  3.19it/s]
Average Metric: 8.00 / 20 (40.0%):  19%|█▉        | 19/100 [00:07<00:25,  3.19it/s]
Average Metric: 8.00 / 20 (40.0%):  20%|██        | 20/100 [00:07<00:28,  2.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 21 (38.1%):  20%|██        | 20/100 [00:07<00:28,  2.76it/s]
Average Metric: 8.00 / 22 (36.4%):  21%|██        | 21/100 [00:07<00:28,  2.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 23 (34.8%):  22%|██▏       | 22/100 [00:07<00:28,  2.76it/s]
Average Metric: 8.00 / 23 (34.8%):  23%|██▎       | 23/100 [00:07<00:23,  3.34it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 24 (37.5%):  23%|██▎       | 23/100 [00:08<00:23,  3.34it/s]
Average Metric: 9.00 / 24 (37.5%):  24%|██▍       | 24/100 [00:08<00:26,  2.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 25 (40.0%):  24%|██▍       | 24/100 [00:08<00:26,  2.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 26 (38.5%):  25%|██▌       | 25/100 [00:08<00:26,  2.87it/s]
Average Metric: 10.00 / 26 (38.5%):  26%|██▌       | 26/100 [00:08<00:20,  3.59it/s]
Average Metric: 10.00 / 27 (37.0%):  26%|██▌       | 26/100 [00:09<00:20,  3.59it/s]
Average Metric: 10.00 / 27 (37.0%):  27%|██▋       | 27/100 [00:09<00:20,  3.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 28 (39.3%):  27%|██▋       | 27/100 [00:09<00:20,  3.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 29 (41.4%):  28%|██▊       | 28/100 [00:09<00:20,  3.50it/s]
Average Metric: 12.00 / 29 (41.4%):  29%|██▉       | 29/100 [00:09<00:22,  3.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 12.00 / 30 (40.0%):  29%|██▉       | 29/100 [00:09<00:22,  3.17it/s]  _warn_reuse()

Average Metric: 13.00 / 31 (41.9%):  30%|███       | 30/100 [00:10<00:22,  3.17it/s]
Average Metric: 13.00 / 31 (41.9%):  31%|███       | 31/100 [00:10<00:18,  3.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 32 (40.6%):  31%|███       | 31/100 [00:10<00:18,  3.69it/s]
Average Metric: 13.00 / 32 (40.6%):  32%|███▏      | 32/100 [00:10<00:17,  3.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 33 (39.4%):  32%|███▏      | 32/100 [00:10<00:17,  3.94it/s]
Average Metric: 13.00 / 33 (39.4%):  33%|███▎      | 33/100 [00:10<00:16,  4.05it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 34 (41.2%):  33%|███▎      | 33/100 [00:11<00:16,  4.05it/s]
Average Metric: 14.00 / 34 (41.2%):  34%|███▍      | 34/100 [00:11<00:26,  2.52it/s]
Average Metric: 14.00 / 35 (40.0%):  34%|███▍      | 34/100 [00:11<00:26,  2.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 36 (41.7%):  35%|███▌      | 35/100 [00:11<00:25,  2.52it/s]
Average Metric: 15.00 / 36 (41.7%):  36%|███▌      | 36/100 [00:11<00:17,  3.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 37 (43.2%):  36%|███▌      | 36/100 [00:11<00:17,  3.73it/s]
Average Metric: 16.00 / 37 (43.2%):  37%|███▋      | 37/100 [00:11<00:17,  3.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 38 (42.1%):  37%|███▋      | 37/100 [00:12<00:17,  3.62it/s]
Average Metric: 16.00 / 38 (42.1%):  38%|███▊      | 38/100 [00:12<00:19,  3.21it/s]
Average Metric: 17.00 / 39 (43.6%):  38%|███▊      | 38/100 [00:12<00:19,  3.21it/s]
Average Metric: 17.00 / 39 (43.6%):  39%|███▉      | 39/100 [00:12<00:20,  3.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 40 (42.5%):  39%|███▉      | 39/100 [00:12<00:20,  3.01it/s]
Average Metric: 17.00 / 40 (42.5%):  40%|████      | 40/100 [00:12<00:17,  3.48it/s]
Average Metric: 17.00 / 41 (41.5%):  40%|████      | 40/100 [00:12<00:17,  3.48it/s]
Average Metric: 18.00 / 42 (42.9%):  41%|████      | 41/100 [00:13<00:16,  3.48it/s]
Average Metric: 18.00 / 42 (42.9%):  42%|████▏     | 42/100 [00:13<00:21,  2.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 43 (44.2%):  42%|████▏     | 42/100 [00:14<00:21,  2.66it/s]
Average Metric: 19.00 / 43 (44.2%):  43%|████▎     | 43/100 [00:14<00:18,  3.10it/s]
Average Metric: 19.00 / 44 (43.2%):  43%|████▎     | 43/100 [00:14<00:18,  3.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 45 (42.2%):  44%|████▍     | 44/100 [00:14<00:18,  3.10it/s]
Average Metric: 19.00 / 45 (42.2%):  45%|████▌     | 45/100 [00:14<00:18,  2.99it/s]
Average Metric: 19.00 / 46 (41.3%):  45%|████▌     | 45/100 [00:15<00:18,  2.99it/s]
Average Metric: 19.00 / 46 (41.3%):  46%|████▌     | 46/100 [00:15<00:20,  2.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 47 (42.6%):  46%|████▌     | 46/100 [00:15<00:20,  2.69it/s]
Average Metric: 21.00 / 48 (43.8%):  47%|████▋     | 47/100 [00:15<00:19,  2.69it/s]
Average Metric: 21.00 / 48 (43.8%):  48%|████▊     | 48/100 [00:15<00:15,  3.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 49 (44.9%):  48%|████▊     | 48/100 [00:15<00:15,  3.37it/s]
Average Metric: 22.00 / 49 (44.9%):  49%|████▉     | 49/100 [00:15<00:14,  3.55it/s]
Average Metric: 22.00 / 50 (44.0%):  49%|████▉     | 49/100 [00:15<00:14,  3.55it/s]
Average Metric: 22.00 / 50 (44.0%):  50%|█████     | 50/100 [00:15<00:12,  4.04it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 51 (43.1%):  50%|█████     | 50/100 [00:16<00:12,  4.04it/s]
Average Metric: 22.00 / 51 (43.1%):  51%|█████     | 51/100 [00:16<00:15,  3.23it/s]
Average Metric: 23.00 / 52 (44.2%):  51%|█████     | 51/100 [00:16<00:15,  3.23it/s]
Average Metric: 23.00 / 52 (44.2%):  52%|█████▏    | 52/100 [00:16<00:15,  3.04it/s]
Average Metric: 24.00 / 53 (45.3%):  52%|█████▏    | 52/100 [00:17<00:15,  3.04it/s]
Average Metric: 24.00 / 53 (45.3%):  53%|█████▎    | 53/100 [00:17<00:15,  3.04it/s]
Average Metric: 25.00 / 54 (46.3%):  53%|█████▎    | 53/100 [00:17<00:15,  3.04it/s]
Average Metric: 25.00 / 54 (46.3%):  54%|█████▍    | 54/100 [00:17<00:15,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 55 (47.3%):  54%|█████▍    | 54/100 [00:18<00:15,  3.03it/s]
Average Metric: 26.00 / 55 (47.3%):  55%|█████▌    | 55/100 [00:18<00:17,  2.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 27.00 / 56 (48.2%):  55%|█████▌    | 55/100 [00:18<00:17,  2.50it/s]
Average Metric: 27.00 / 56 (48.2%):  56%|█████▌    | 56/100 [00:18<00:14,  2.98it/s]  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 57 (47.4%):  56%|█████▌    | 56/100 [00:18<00:14,  2.98it/s]
Average Metric: 27.00 / 58 (46.6%):  57%|█████▋    | 57/100 [00:18<00:14,  2.98it/s]
Average Metric: 27.00 / 58 (46.6%):  58%|█████▊    | 58/100 [00:18<00:08,  4.80it/s]
Average Metric: 28.00 / 59 (47.5%):  58%|█████▊    | 58/100 [00:18<00:08,  4.80it/s]
Average Metric: 28.00 / 59 (47.5%):  59%|█████▉    | 59/100 [00:18<00:09,  4.52it/s]
Average Metric: 29.00 / 60 (48.3%):  59%|█████▉    | 59/100 [00:18<00:09,  4.52it/s]
Average Metric: 29.00 / 60 (48.3%):  60%|██████    | 60/100 [00:18<00:09,  4.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 30.00 / 61 (49.2%):  60%|██████    | 60/100 [00:19<00:09,  4.43it/s]
Average Metric: 30.00 / 61 (49.2%):  61%|██████    | 61/100 [00:19<00:14,  2.69it/s]  _warn_reuse()

Average Metric: 30.00 / 62 (48.4%):  61%|██████    | 61/100 [00:19<00:14,  2.69it/s]
Average Metric: 30.00 / 62 (48.4%):  62%|██████▏   | 62/100 [00:19<00:13,  2.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 30.00 / 63 (47.6%):  62%|██████▏   | 62/100 [00:20<00:13,  2.85it/s]
Average Metric: 30.00 / 63 (47.6%):  63%|██████▎   | 63/100 [00:20<00:11,  3.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 64 (48.4%):  63%|██████▎   | 63/100 [00:20<00:11,  3.19it/s]
Average Metric: 31.00 / 64 (48.4%):  64%|██████▍   | 64/100 [00:20<00:09,  3.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 65 (49.2%):  64%|██████▍   | 64/100 [00:20<00:09,  3.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 66 (50.0%):  65%|██████▌   | 65/100 [00:20<00:09,  3.67it/s]
Average Metric: 33.00 / 66 (50.0%):  66%|██████▌   | 66/100 [00:20<00:06,  5.05it/s]
Average Metric: 34.00 / 67 (50.7%):  66%|██████▌   | 66/100 [00:21<00:06,  5.05it/s]
Average Metric: 34.00 / 67 (50.7%):  67%|██████▋   | 67/100 [00:21<00:08,  3.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 68 (51.5%):  67%|██████▋   | 67/100 [00:21<00:08,  3.73it/s]
Average Metric: 35.00 / 68 (51.5%):  68%|██████▊   | 68/100 [00:21<00:10,  3.01it/s]
Average Metric: 35.00 / 69 (50.7%):  68%|██████▊   | 68/100 [00:21<00:10,  3.01it/s]
Average Metric: 35.00 / 69 (50.7%):  69%|██████▉   | 69/100 [00:21<00:09,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 70 (51.4%):  69%|██████▉   | 69/100 [00:21<00:09,  3.21it/s]
Average Metric: 36.00 / 70 (51.4%):  70%|███████   | 70/100 [00:21<00:07,  3.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 71 (52.1%):  70%|███████   | 70/100 [00:21<00:07,  3.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 72 (51.4%):  71%|███████   | 71/100 [00:22<00:07,  3.83it/s]
Average Metric: 37.00 / 73 (50.7%):  72%|███████▏  | 72/100 [00:22<00:07,  3.83it/s]
Average Metric: 37.00 / 73 (50.7%):  73%|███████▎  | 73/100 [00:22<00:07,  3.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 74 (51.4%):  73%|███████▎  | 73/100 [00:22<00:07,  3.74it/s]
Average Metric: 38.00 / 74 (51.4%):  74%|███████▍  | 74/100 [00:22<00:06,  3.93it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 75 (52.0%):  74%|███████▍  | 74/100 [00:23<00:06,  3.93it/s]
Average Metric: 39.00 / 75 (52.0%):  75%|███████▌  | 75/100 [00:23<00:07,  3.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 76 (51.3%):  75%|███████▌  | 75/100 [00:23<00:07,  3.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 77 (51.9%):  76%|███████▌  | 76/100 [00:23<00:07,  3.14it/s]
Average Metric: 40.00 / 77 (51.9%):  77%|███████▋  | 77/100 [00:23<00:06,  3.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 78 (52.6%):  77%|███████▋  | 77/100 [00:24<00:06,  3.71it/s]
Average Metric: 41.00 / 78 (52.6%):  78%|███████▊  | 78/100 [00:24<00:07,  2.84it/s]
Average Metric: 41.00 / 79 (51.9%):  78%|███████▊  | 78/100 [00:24<00:07,  2.84it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 80 (52.5%):  79%|███████▉  | 79/100 [00:24<00:07,  2.84it/s]
Average Metric: 42.00 / 80 (52.5%):  80%|████████  | 80/100 [00:24<00:05,  3.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 81 (53.1%):  80%|████████  | 80/100 [00:25<00:05,  3.57it/s]
Average Metric: 43.00 / 81 (53.1%):  81%|████████  | 81/100 [00:25<00:04,  3.85it/s]
Average Metric: 44.00 / 82 (53.7%):  81%|████████  | 81/100 [00:25<00:04,  3.85it/s]
Average Metric: 45.00 / 83 (54.2%):  82%|████████▏ | 82/100 [00:25<00:04,  3.85it/s]
Average Metric: 45.00 / 83 (54.2%):  83%|████████▎ | 83/100 [00:25<00:04,  3.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 84 (54.8%):  83%|████████▎ | 83/100 [00:26<00:04,  3.74it/s]
Average Metric: 46.00 / 84 (54.8%):  84%|████████▍ | 84/100 [00:26<00:05,  3.15it/s]
Average Metric: 47.00 / 85 (55.3%):  84%|████████▍ | 84/100 [00:26<00:05,  3.15it/s]
Average Metric: 47.00 / 85 (55.3%):  85%|████████▌ | 85/100 [00:26<00:04,  3.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 86 (55.8%):  85%|████████▌ | 85/100 [00:26<00:04,  3.13it/s]
Average Metric: 48.00 / 86 (55.8%):  86%|████████▌ | 86/100 [00:26<00:04,  3.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 87 (56.3%):  86%|████████▌ | 86/100 [00:26<00:04,  3.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 88 (56.8%):  87%|████████▋ | 87/100 [00:26<00:03,  3.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 89 (56.2%):  88%|████████▊ | 88/100 [00:27<00:03,  3.48it/s]
Average Metric: 50.00 / 89 (56.2%):  89%|████████▉ | 89/100 [00:27<00:03,  3.13it/s]
Average Metric: 50.00 / 90 (55.6%):  89%|████████▉ | 89/100 [00:27<00:03,  3.13it/s]
Average Metric: 50.00 / 90 (55.6%):  90%|█████████ | 90/100 [00:27<00:02,  3.59it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 91 (56.0%):  90%|█████████ | 90/100 [00:28<00:02,  3.59it/s]
Average Metric: 51.00 / 91 (56.0%):  91%|█████████ | 91/100 [00:28<00:02,  3.77it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 52.00 / 92 (56.5%):  91%|█████████ | 91/100 [00:28<00:02,  3.77it/s]
Average Metric: 53.00 / 93 (57.0%):  92%|█████████▏| 92/100 [00:28<00:02,  3.77it/s]
Average Metric: 53.00 / 93 (57.0%):  93%|█████████▎| 93/100 [00:28<00:01,  4.68it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 94 (56.4%):  93%|█████████▎| 93/100 [00:28<00:01,  4.68it/s]
Average Metric: 53.00 / 94 (56.4%):  94%|█████████▍| 94/100 [00:28<00:01,  4.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 95 (56.8%):  94%|█████████▍| 94/100 [00:28<00:01,  4.11it/s]
Average Metric: 54.00 / 95 (56.8%):  95%|█████████▌| 95/100 [00:28<00:01,  3.95it/s]
Average Metric: 55.00 / 96 (57.3%):  95%|█████████▌| 95/100 [00:29<00:01,  3.95it/s]
Average Metric: 55.00 / 96 (57.3%):  96%|█████████▌| 96/100 [00:29<00:01,  3.51it/s]
Average Metric: 55.00 / 97 (56.7%):  96%|█████████▌| 96/100 [00:29<00:01,  3.51it/s]
Average Metric: 55.00 / 98 (56.1%):  97%|█████████▋| 97/100 [00:29<00:00,  3.51it/s]
Average Metric: 55.00 / 98 (56.1%):  98%|█████████▊| 98/100 [00:29<00:00,  4.31it/s]
Average Metric: 56.00 / 99 (56.6%):  98%|█████████▊| 98/100 [00:29<00:00,  4.31it/s]
Average Metric: 56.00 / 99 (56.6%):  99%|█████████▉| 99/100 [00:29<00:00,  3.93it/s]2025/04/28 17:13:46 INFO dspy.evaluate.evaluate: Average Metric: 57 / 100 (57.0%)

Average Metric: 57.00 / 100 (57.0%):  99%|█████████▉| 99/100 [00:29<00:00,  3.93it/s]
Average Metric: 57.00 / 100 (57.0%): 100%|██████████| 100/100 [00:29<00:00,  3.34it/s]
2025/04/28 17:13:46 INFO dspy.teleprompt.mipro_optimizer_v2: Default program score: 57.0

/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/optuna/_experimental.py:31: ExperimentalWarning: Argument ``multivariate`` is an experimental feature. The interface can change in the future.
  warnings.warn(
2025/04/28 17:13:46 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 2 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 0.00 / 1 (0.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 0.00 / 1 (0.0%):   4%|▍         | 1/25 [00:01<00:40,  1.70s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 1.00 / 2 (50.0%):   4%|▍         | 1/25 [00:01<00:40,  1.70s/it]
Average Metric: 1.00 / 2 (50.0%):   8%|▊         | 2/25 [00:01<00:17,  1.30it/s]  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 3 (33.3%):   8%|▊         | 2/25 [00:02<00:17,  1.30it/s]
Average Metric: 1.00 / 3 (33.3%):  12%|█▏        | 3/25 [00:02<00:14,  1.53it/s]
Average Metric: 2.00 / 4 (50.0%):  12%|█▏        | 3/25 [00:02<00:14,  1.53it/s]
Average Metric: 2.00 / 4 (50.0%):  16%|█▌        | 4/25 [00:02<00:10,  2.02it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 5 (60.0%):  16%|█▌        | 4/25 [00:02<00:10,  2.02it/s]
Average Metric: 3.00 / 5 (60.0%):  20%|██        | 5/25 [00:02<00:08,  2.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 6 (66.7%):  20%|██        | 5/25 [00:03<00:08,  2.37it/s]
Average Metric: 4.00 / 6 (66.7%):  24%|██▍       | 6/25 [00:03<00:07,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 7 (71.4%):  24%|██▍       | 6/25 [00:03<00:07,  2.43it/s]
Average Metric: 5.00 / 7 (71.4%):  28%|██▊       | 7/25 [00:03<00:08,  2.15it/s]
Average Metric: 6.00 / 8 (75.0%):  28%|██▊       | 7/25 [00:04<00:08,  2.15it/s]
Average Metric: 6.00 / 8 (75.0%):  32%|███▏      | 8/25 [00:04<00:08,  1.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):  32%|███▏      | 8/25 [00:04<00:08,  1.92it/s]
Average Metric: 7.00 / 9 (77.8%):  36%|███▌      | 9/25 [00:04<00:06,  2.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 10 (80.0%):  36%|███▌      | 9/25 [00:04<00:06,  2.50it/s]
Average Metric: 8.00 / 10 (80.0%):  40%|████      | 10/25 [00:04<00:05,  2.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 11 (81.8%):  40%|████      | 10/25 [00:04<00:05,  2.92it/s]
Average Metric: 9.00 / 11 (81.8%):  44%|████▍     | 11/25 [00:04<00:03,  3.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 12 (83.3%):  44%|████▍     | 11/25 [00:05<00:03,  3.65it/s]
Average Metric: 10.00 / 12 (83.3%):  48%|████▊     | 12/25 [00:05<00:04,  2.61it/s]
Average Metric: 10.00 / 13 (76.9%):  48%|████▊     | 12/25 [00:05<00:04,  2.61it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 14 (78.6%):  52%|█████▏    | 13/25 [00:06<00:04,  2.61it/s]
Average Metric: 11.00 / 14 (78.6%):  56%|█████▌    | 14/25 [00:06<00:03,  2.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:06<00:03,  2.78it/s]
Average Metric: 11.00 / 15 (73.3%):  60%|██████    | 15/25 [00:06<00:03,  2.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:06<00:03,  2.71it/s]
Average Metric: 12.00 / 16 (75.0%):  64%|██████▍   | 16/25 [00:06<00:02,  3.08it/s]
Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:07<00:02,  3.08it/s]
Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:07<00:02,  3.50it/s]
Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:07<00:02,  3.50it/s]
Average Metric: 13.00 / 18 (72.2%):  72%|███████▏  | 18/25 [00:07<00:02,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 19 (73.7%):  72%|███████▏  | 18/25 [00:07<00:02,  2.40it/s]
Average Metric: 14.00 / 19 (73.7%):  76%|███████▌  | 19/25 [00:07<00:02,  2.80it/s]
Average Metric: 15.00 / 20 (75.0%):  76%|███████▌  | 19/25 [00:08<00:02,  2.80it/s]
Average Metric: 15.00 / 20 (75.0%):  80%|████████  | 20/25 [00:08<00:01,  3.02it/s]
Average Metric: 16.00 / 21 (76.2%):  80%|████████  | 20/25 [00:08<00:01,  3.02it/s]
Average Metric: 16.00 / 21 (76.2%):  84%|████████▍ | 21/25 [00:08<00:01,  3.01it/s]
Average Metric: 17.00 / 22 (77.3%):  84%|████████▍ | 21/25 [00:09<00:01,  3.01it/s]
Average Metric: 17.00 / 22 (77.3%):  88%|████████▊ | 22/25 [00:09<00:01,  2.15it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:09<00:01,  2.15it/s]
Average Metric: 18.00 / 23 (78.3%):  92%|█████████▏| 23/25 [00:09<00:00,  2.24it/s]
Average Metric: 19.00 / 24 (79.2%):  92%|█████████▏| 23/25 [00:09<00:00,  2.24it/s]2025/04/28 17:13:58 INFO dspy.evaluate.evaluate: Average Metric: 20 / 25 (80.0%)

Average Metric: 20.00 / 25 (80.0%):  96%|█████████▌| 24/25 [00:11<00:00,  2.24it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:11<00:00,  1.43it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:11<00:00,  2.13it/s]
2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 80.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 1', 'Predictor 0: Few-Shot Set 1'].
2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0]
2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/28 17:13:58 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 3 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.49s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.49s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:18,  1.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   8%|▊         | 2/25 [00:02<00:18,  1.24it/s]
Average Metric: 3.00 / 3 (100.0%):  12%|█▏        | 3/25 [00:02<00:11,  1.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 4 (75.0%):  12%|█▏        | 3/25 [00:02<00:11,  1.89it/s] 
Average Metric: 3.00 / 4 (75.0%):  16%|█▌        | 4/25 [00:02<00:07,  2.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 5 (80.0%):  16%|█▌        | 4/25 [00:02<00:07,  2.75it/s]
Average Metric: 4.00 / 5 (80.0%):  20%|██        | 5/25 [00:02<00:08,  2.41it/s]
Average Metric: 5.00 / 6 (83.3%):  20%|██        | 5/25 [00:02<00:08,  2.41it/s]
Average Metric: 5.00 / 7 (71.4%):  24%|██▍       | 6/25 [00:03<00:07,  2.41it/s]
Average Metric: 5.00 / 7 (71.4%):  28%|██▊       | 7/25 [00:03<00:07,  2.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 8 (75.0%):  28%|██▊       | 7/25 [00:03<00:07,  2.39it/s]
Average Metric: 6.00 / 8 (75.0%):  32%|███▏      | 8/25 [00:03<00:06,  2.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 9 (66.7%):  32%|███▏      | 8/25 [00:04<00:06,  2.54it/s]
Average Metric: 6.00 / 9 (66.7%):  36%|███▌      | 9/25 [00:04<00:05,  2.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 10 (70.0%):  36%|███▌      | 9/25 [00:04<00:05,  2.72it/s]
Average Metric: 7.00 / 10 (70.0%):  40%|████      | 10/25 [00:04<00:05,  2.87it/s]
Average Metric: 8.00 / 11 (72.7%):  40%|████      | 10/25 [00:04<00:05,  2.87it/s]
Average Metric: 8.00 / 11 (72.7%):  44%|████▍     | 11/25 [00:04<00:04,  3.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 12 (75.0%):  44%|████▍     | 11/25 [00:04<00:04,  3.40it/s]
Average Metric: 9.00 / 12 (75.0%):  48%|████▊     | 12/25 [00:04<00:03,  4.07it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 13 (76.9%):  48%|████▊     | 12/25 [00:05<00:03,  4.07it/s]
Average Metric: 10.00 / 13 (76.9%):  52%|█████▏    | 13/25 [00:05<00:03,  3.77it/s]
Average Metric: 11.00 / 14 (78.6%):  52%|█████▏    | 13/25 [00:05<00:03,  3.77it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 15 (80.0%):  56%|█████▌    | 14/25 [00:05<00:02,  3.77it/s]
Average Metric: 12.00 / 15 (80.0%):  60%|██████    | 15/25 [00:05<00:03,  3.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 16 (81.2%):  60%|██████    | 15/25 [00:06<00:03,  3.33it/s]
Average Metric: 13.00 / 16 (81.2%):  64%|██████▍   | 16/25 [00:06<00:02,  3.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 17 (82.4%):  64%|██████▍   | 16/25 [00:06<00:02,  3.10it/s]
Average Metric: 14.00 / 17 (82.4%):  68%|██████▊   | 17/25 [00:06<00:02,  3.68it/s]
Average Metric: 15.00 / 18 (83.3%):  68%|██████▊   | 17/25 [00:06<00:02,  3.68it/s]
Average Metric: 15.00 / 18 (83.3%):  72%|███████▏  | 18/25 [00:06<00:02,  3.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 19 (78.9%):  72%|███████▏  | 18/25 [00:07<00:02,  3.10it/s]
Average Metric: 15.00 / 19 (78.9%):  76%|███████▌  | 19/25 [00:07<00:01,  3.05it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 20 (80.0%):  76%|███████▌  | 19/25 [00:07<00:01,  3.05it/s]
Average Metric: 16.00 / 20 (80.0%):  80%|████████  | 20/25 [00:07<00:01,  2.69it/s]
Average Metric: 17.00 / 21 (81.0%):  80%|████████  | 20/25 [00:07<00:01,  2.69it/s]
Average Metric: 17.00 / 21 (81.0%):  84%|████████▍ | 21/25 [00:07<00:01,  3.07it/s]
Average Metric: 18.00 / 22 (81.8%):  84%|████████▍ | 21/25 [00:07<00:01,  3.07it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:08<00:00,  3.07it/s]
Average Metric: 18.00 / 23 (78.3%):  92%|█████████▏| 23/25 [00:08<00:00,  3.37it/s]
Average Metric: 18.00 / 24 (75.0%):  92%|█████████▏| 23/25 [00:08<00:00,  3.37it/s]
Average Metric: 18.00 / 24 (75.0%):  96%|█████████▌| 24/25 [00:08<00:00,  2.87it/s]2025/04/28 17:14:07 INFO dspy.evaluate.evaluate: Average Metric: 19 / 25 (76.0%)
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 76.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 2', 'Predictor 0: Few-Shot Set 1'].
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0, 76.0]
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================



Average Metric: 19.00 / 25 (76.0%):  96%|█████████▌| 24/25 [00:09<00:00,  2.87it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:09<00:00,  2.33it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:09<00:00,  2.66it/s]
2025/04/28 17:14:07 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 4 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.47s/it]
Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.47s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:19,  1.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   8%|▊         | 2/25 [00:02<00:19,  1.18it/s]
Average Metric: 3.00 / 3 (100.0%):  12%|█▏        | 3/25 [00:02<00:13,  1.68it/s]
Average Metric: 4.00 / 4 (100.0%):  12%|█▏        | 3/25 [00:02<00:13,  1.68it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 5 (100.0%):  16%|█▌        | 4/25 [00:02<00:12,  1.68it/s]
Average Metric: 5.00 / 5 (100.0%):  20%|██        | 5/25 [00:02<00:08,  2.41it/s]
Average Metric: 5.00 / 6 (83.3%):  20%|██        | 5/25 [00:02<00:08,  2.41it/s] 
Average Metric: 5.00 / 6 (83.3%):  24%|██▍       | 6/25 [00:02<00:06,  2.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 7 (85.7%):  24%|██▍       | 6/25 [00:03<00:06,  2.80it/s]
Average Metric: 6.00 / 7 (85.7%):  28%|██▊       | 7/25 [00:03<00:09,  1.91it/s]
Average Metric: 7.00 / 8 (87.5%):  28%|██▊       | 7/25 [00:04<00:09,  1.91it/s]
Average Metric: 7.00 / 8 (87.5%):  32%|███▏      | 8/25 [00:04<00:07,  2.16it/s]
Average Metric: 7.00 / 9 (77.8%):  32%|███▏      | 8/25 [00:04<00:07,  2.16it/s]
Average Metric: 7.00 / 9 (77.8%):  36%|███▌      | 9/25 [00:04<00:05,  2.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 10 (80.0%):  36%|███▌      | 9/25 [00:05<00:05,  2.75it/s]
Average Metric: 8.00 / 10 (80.0%):  40%|████      | 10/25 [00:05<00:07,  2.02it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 11 (72.7%):  40%|████      | 10/25 [00:05<00:07,  2.02it/s]
Average Metric: 8.00 / 11 (72.7%):  44%|████▍     | 11/25 [00:05<00:05,  2.48it/s]
Average Metric: 9.00 / 12 (75.0%):  44%|████▍     | 11/25 [00:05<00:05,  2.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 13 (76.9%):  48%|████▊     | 12/25 [00:06<00:05,  2.48it/s]
Average Metric: 10.00 / 13 (76.9%):  52%|█████▏    | 13/25 [00:06<00:04,  2.55it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 14 (78.6%):  52%|█████▏    | 13/25 [00:06<00:04,  2.55it/s]
Average Metric: 11.00 / 14 (78.6%):  56%|█████▌    | 14/25 [00:06<00:05,  2.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 15 (80.0%):  56%|█████▌    | 14/25 [00:07<00:05,  2.12it/s]
Average Metric: 12.00 / 15 (80.0%):  60%|██████    | 15/25 [00:07<00:05,  1.88it/s]
Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:07<00:05,  1.88it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:07<00:04,  1.88it/s]
Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:07<00:02,  3.00it/s]
Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:08<00:02,  3.00it/s]
Average Metric: 13.00 / 18 (72.2%):  72%|███████▏  | 18/25 [00:08<00:03,  2.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 19 (73.7%):  72%|███████▏  | 18/25 [00:08<00:03,  2.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 20 (70.0%):  76%|███████▌  | 19/25 [00:09<00:02,  2.08it/s]
Average Metric: 14.00 / 20 (70.0%):  80%|████████  | 20/25 [00:09<00:02,  2.36it/s]
Average Metric: 15.00 / 21 (71.4%):  80%|████████  | 20/25 [00:09<00:02,  2.36it/s]
Average Metric: 15.00 / 21 (71.4%):  84%|████████▍ | 21/25 [00:09<00:01,  2.53it/s]
Average Metric: 16.00 / 22 (72.7%):  84%|████████▍ | 21/25 [00:09<00:01,  2.53it/s]
Average Metric: 16.00 / 22 (72.7%):  88%|████████▊ | 22/25 [00:09<00:01,  2.83it/s]
Average Metric: 16.00 / 23 (69.6%):  88%|████████▊ | 22/25 [00:11<00:01,  2.83it/s]
Average Metric: 16.00 / 23 (69.6%):  92%|█████████▏| 23/25 [00:11<00:01,  1.50it/s]
Average Metric: 17.00 / 24 (70.8%):  92%|█████████▏| 23/25 [00:11<00:01,  1.50it/s]
Average Metric: 17.00 / 24 (70.8%):  96%|█████████▌| 24/25 [00:11<00:00,  1.80it/s]2025/04/28 17:14:19 INFO dspy.evaluate.evaluate: Average Metric: 18 / 25 (72.0%)

Average Metric: 18.00 / 25 (72.0%):  96%|█████████▌| 24/25 [00:11<00:00,  1.80it/s]
Average Metric: 18.00 / 25 (72.0%): 100%|██████████| 25/25 [00:11<00:00,  2.14it/s]
Average Metric: 18.00 / 25 (72.0%): 100%|██████████| 25/25 [00:11<00:00,  2.11it/s]
2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 72.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 4', 'Predictor 0: Few-Shot Set 1'].
2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0, 76.0, 72.0]
2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/28 17:14:19 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 5 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:40,  1.68s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:40,  1.68s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   8%|▊         | 2/25 [00:02<00:38,  1.68s/it]
Average Metric: 3.00 / 3 (100.0%):  12%|█▏        | 3/25 [00:02<00:15,  1.43it/s]
Average Metric: 4.00 / 4 (100.0%):  12%|█▏        | 3/25 [00:02<00:15,  1.43it/s]
Average Metric: 4.00 / 4 (100.0%):  16%|█▌        | 4/25 [00:02<00:11,  1.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 5 (100.0%):  16%|█▌        | 4/25 [00:02<00:11,  1.90it/s]
Average Metric: 5.00 / 5 (100.0%):  20%|██        | 5/25 [00:02<00:08,  2.37it/s]
Average Metric: 6.00 / 6 (100.0%):  20%|██        | 5/25 [00:03<00:08,  2.37it/s]
Average Metric: 6.00 / 6 (100.0%):  24%|██▍       | 6/25 [00:03<00:06,  2.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 7 (85.7%):  24%|██▍       | 6/25 [00:03<00:06,  2.82it/s] 
Average Metric: 6.00 / 7 (85.7%):  28%|██▊       | 7/25 [00:03<00:07,  2.34it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):  28%|██▊       | 7/25 [00:03<00:07,  2.34it/s]
Average Metric: 7.00 / 8 (87.5%):  32%|███▏      | 8/25 [00:03<00:05,  2.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):  32%|███▏      | 8/25 [00:03<00:05,  2.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 10 (80.0%):  36%|███▌      | 9/25 [00:04<00:05,  2.91it/s]
Average Metric: 8.00 / 10 (80.0%):  40%|████      | 10/25 [00:04<00:05,  2.68it/s]
Average Metric: 9.00 / 11 (81.8%):  40%|████      | 10/25 [00:04<00:05,  2.68it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 10.00 / 12 (83.3%):  44%|████▍     | 11/25 [00:04<00:05,  2.68it/s]
Average Metric: 10.00 / 12 (83.3%):  48%|████▊     | 12/25 [00:04<00:03,  3.77it/s]  _warn_reuse()

Average Metric: 11.00 / 13 (84.6%):  48%|████▊     | 12/25 [00:05<00:03,  3.77it/s]
Average Metric: 11.00 / 13 (84.6%):  52%|█████▏    | 13/25 [00:05<00:04,  2.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 14 (85.7%):  52%|█████▏    | 13/25 [00:05<00:04,  2.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 15 (86.7%):  56%|█████▌    | 14/25 [00:06<00:04,  2.71it/s]
Average Metric: 13.00 / 15 (86.7%):  60%|██████    | 15/25 [00:06<00:03,  3.12it/s]
Average Metric: 14.00 / 16 (87.5%):  60%|██████    | 15/25 [00:06<00:03,  3.12it/s]
Average Metric: 14.00 / 16 (87.5%):  64%|██████▍   | 16/25 [00:06<00:02,  3.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 17 (88.2%):  64%|██████▍   | 16/25 [00:06<00:02,  3.46it/s]
Average Metric: 15.00 / 17 (88.2%):  68%|██████▊   | 17/25 [00:06<00:02,  3.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 18 (83.3%):  68%|██████▊   | 17/25 [00:06<00:02,  3.24it/s]
Average Metric: 15.00 / 18 (83.3%):  72%|███████▏  | 18/25 [00:06<00:02,  3.26it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 19 (84.2%):  72%|███████▏  | 18/25 [00:07<00:02,  3.26it/s]
Average Metric: 16.00 / 19 (84.2%):  76%|███████▌  | 19/25 [00:07<00:02,  2.57it/s]
Average Metric: 16.00 / 20 (80.0%):  76%|███████▌  | 19/25 [00:08<00:02,  2.57it/s]
Average Metric: 16.00 / 20 (80.0%):  80%|████████  | 20/25 [00:08<00:02,  2.14it/s]
Average Metric: 17.00 / 21 (81.0%):  80%|████████  | 20/25 [00:08<00:02,  2.14it/s]
Average Metric: 17.00 / 21 (81.0%):  84%|████████▍ | 21/25 [00:08<00:01,  2.37it/s]
Average Metric: 18.00 / 22 (81.8%):  84%|████████▍ | 21/25 [00:08<00:01,  2.37it/s]
Average Metric: 19.00 / 23 (82.6%):  88%|████████▊ | 22/25 [00:08<00:01,  2.37it/s]
Average Metric: 19.00 / 23 (82.6%):  92%|█████████▏| 23/25 [00:08<00:00,  3.65it/s]
Average Metric: 19.00 / 24 (79.2%):  92%|█████████▏| 23/25 [00:09<00:00,  3.65it/s]
Average Metric: 19.00 / 24 (79.2%):  96%|█████████▌| 24/25 [00:09<00:00,  3.35it/s]2025/04/28 17:14:30 INFO dspy.evaluate.evaluate: Average Metric: 20 / 25 (80.0%)
2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 80.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 2', 'Predictor 0: Few-Shot Set 1'].
2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0, 76.0, 72.0, 80.0]
2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/28 17:14:30 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 6 / 8 - Minibatch ==

Average Metric: 20.00 / 25 (80.0%):  96%|█████████▌| 24/25 [00:10<00:00,  3.35it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:10<00:00,  1.55it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:10<00:00,  2.35it/s]
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:00<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:00<00:20,  1.14it/s]
Average Metric: 1.00 / 2 (50.0%):   4%|▍         | 1/25 [00:01<00:20,  1.14it/s] 
Average Metric: 1.00 / 2 (50.0%):   8%|▊         | 2/25 [00:01<00:15,  1.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 3 (33.3%):   8%|▊         | 2/25 [00:01<00:15,  1.49it/s]
Average Metric: 1.00 / 3 (33.3%):  12%|█▏        | 3/25 [00:01<00:09,  2.28it/s]
Average Metric: 2.00 / 4 (50.0%):  12%|█▏        | 3/25 [00:01<00:09,  2.28it/s]
Average Metric: 2.00 / 4 (50.0%):  16%|█▌        | 4/25 [00:01<00:07,  2.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 5 (40.0%):  16%|█▌        | 4/25 [00:02<00:07,  2.95it/s]
Average Metric: 2.00 / 5 (40.0%):  20%|██        | 5/25 [00:02<00:09,  2.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 6 (50.0%):  20%|██        | 5/25 [00:02<00:09,  2.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 7 (57.1%):  24%|██▍       | 6/25 [00:02<00:09,  2.01it/s]
Average Metric: 4.00 / 7 (57.1%):  28%|██▊       | 7/25 [00:02<00:05,  3.15it/s]
Average Metric: 5.00 / 8 (62.5%):  28%|██▊       | 7/25 [00:03<00:05,  3.15it/s]
Average Metric: 5.00 / 8 (62.5%):  32%|███▏      | 8/25 [00:03<00:05,  3.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 9 (55.6%):  32%|███▏      | 8/25 [00:03<00:05,  3.09it/s]
Average Metric: 5.00 / 9 (55.6%):  36%|███▌      | 9/25 [00:03<00:04,  3.58it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 10 (60.0%):  36%|███▌      | 9/25 [00:03<00:04,  3.58it/s]
Average Metric: 7.00 / 11 (63.6%):  40%|████      | 10/25 [00:03<00:04,  3.58it/s]
Average Metric: 7.00 / 11 (63.6%):  44%|████▍     | 11/25 [00:03<00:03,  3.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 12 (66.7%):  44%|████▍     | 11/25 [00:04<00:03,  3.95it/s]
Average Metric: 8.00 / 12 (66.7%):  48%|████▊     | 12/25 [00:04<00:03,  3.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 13 (69.2%):  48%|████▊     | 12/25 [00:04<00:03,  3.52it/s]
Average Metric: 9.00 / 13 (69.2%):  52%|█████▏    | 13/25 [00:04<00:03,  3.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 14 (71.4%):  52%|█████▏    | 13/25 [00:04<00:03,  3.25it/s]
Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:04<00:03,  3.25it/s]
Average Metric: 11.00 / 15 (73.3%):  60%|██████    | 15/25 [00:04<00:02,  3.99it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:05<00:02,  3.99it/s]
Average Metric: 12.00 / 16 (75.0%):  64%|██████▍   | 16/25 [00:05<00:02,  4.19it/s]  _warn_reuse()

Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:05<00:02,  4.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:05<00:02,  3.08it/s]  _warn_reuse()

Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:05<00:02,  3.08it/s]
Average Metric: 13.00 / 18 (72.2%):  72%|███████▏  | 18/25 [00:05<00:02,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 19 (68.4%):  72%|███████▏  | 18/25 [00:06<00:02,  3.18it/s]
Average Metric: 13.00 / 19 (68.4%):  76%|███████▌  | 19/25 [00:06<00:01,  3.38it/s]
Average Metric: 14.00 / 20 (70.0%):  76%|███████▌  | 19/25 [00:06<00:01,  3.38it/s]
Average Metric: 14.00 / 21 (66.7%):  80%|████████  | 20/25 [00:06<00:01,  3.38it/s]
Average Metric: 15.00 / 22 (68.2%):  84%|████████▍ | 21/25 [00:06<00:01,  3.38it/s]
Average Metric: 15.00 / 22 (68.2%):  88%|████████▊ | 22/25 [00:06<00:00,  4.12it/s]
Average Metric: 16.00 / 23 (69.6%):  88%|████████▊ | 22/25 [00:06<00:00,  4.12it/s]
Average Metric: 16.00 / 23 (69.6%):  92%|█████████▏| 23/25 [00:06<00:00,  4.21it/s]
Average Metric: 17.00 / 24 (70.8%):  92%|█████████▏| 23/25 [00:07<00:00,  4.21it/s]
Average Metric: 17.00 / 24 (70.8%):  96%|█████████▌| 24/25 [00:07<00:00,  3.90it/s]2025/04/28 17:14:38 INFO dspy.evaluate.evaluate: Average Metric: 17 / 25 (68.0%)

Average Metric: 17.00 / 25 (68.0%):  96%|█████████▌| 24/25 [00:07<00:00,  3.90it/s]
Average Metric: 17.00 / 25 (68.0%): 100%|██████████| 25/25 [00:07<00:00,  2.96it/s]
Average Metric: 17.00 / 25 (68.0%): 100%|██████████| 25/25 [00:07<00:00,  3.17it/s]
2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 68.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 4', 'Predictor 0: Few-Shot Set 3'].
2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0, 76.0, 72.0, 80.0, 68.0]
2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/28 17:14:38 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 7 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.49s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:35,  1.49s/it]
Average Metric: 2.00 / 3 (66.7%):   8%|▊         | 2/25 [00:01<00:34,  1.49s/it] 
Average Metric: 2.00 / 3 (66.7%):  12%|█▏        | 3/25 [00:01<00:10,  2.18it/s]
Average Metric: 3.00 / 4 (75.0%):  12%|█▏        | 3/25 [00:01<00:10,  2.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 5 (80.0%):  16%|█▌        | 4/25 [00:02<00:09,  2.18it/s]
Average Metric: 4.00 / 5 (80.0%):  20%|██        | 5/25 [00:02<00:06,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 6 (83.3%):  20%|██        | 5/25 [00:02<00:06,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 7 (85.7%):  24%|██▍       | 6/25 [00:02<00:06,  2.96it/s]
Average Metric: 6.00 / 7 (85.7%):  28%|██▊       | 7/25 [00:02<00:06,  2.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):  28%|██▊       | 7/25 [00:03<00:06,  2.89it/s]
Average Metric: 7.00 / 8 (87.5%):  32%|███▏      | 8/25 [00:03<00:06,  2.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 9 (88.9%):  32%|███▏      | 8/25 [00:03<00:06,  2.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 10 (90.0%):  36%|███▌      | 9/25 [00:03<00:05,  2.74it/s]
Average Metric: 9.00 / 10 (90.0%):  40%|████      | 10/25 [00:03<00:04,  3.03it/s]
Average Metric: 10.00 / 11 (90.9%):  40%|████      | 10/25 [00:03<00:04,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 12 (83.3%):  44%|████▍     | 11/25 [00:03<00:04,  3.03it/s]
Average Metric: 10.00 / 13 (76.9%):  48%|████▊     | 12/25 [00:04<00:04,  3.03it/s]
Average Metric: 10.00 / 13 (76.9%):  52%|█████▏    | 13/25 [00:04<00:03,  3.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 14 (71.4%):  52%|█████▏    | 13/25 [00:04<00:03,  3.76it/s]
Average Metric: 10.00 / 14 (71.4%):  56%|█████▌    | 14/25 [00:04<00:02,  3.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:04<00:02,  3.86it/s]
Average Metric: 11.00 / 15 (73.3%):  60%|██████    | 15/25 [00:04<00:02,  4.23it/s]  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:05<00:02,  4.23it/s]
Average Metric: 12.00 / 16 (75.0%):  64%|██████▍   | 16/25 [00:05<00:02,  3.68it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:05<00:02,  3.68it/s]
Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:05<00:01,  4.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 18 (77.8%):  68%|██████▊   | 17/25 [00:05<00:01,  4.09it/s]
Average Metric: 14.00 / 18 (77.8%):  72%|███████▏  | 18/25 [00:05<00:01,  4.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 19 (78.9%):  72%|███████▏  | 18/25 [00:05<00:01,  4.65it/s]
Average Metric: 15.00 / 19 (78.9%):  76%|███████▌  | 19/25 [00:05<00:01,  3.42it/s]
Average Metric: 16.00 / 20 (80.0%):  76%|███████▌  | 19/25 [00:06<00:01,  3.42it/s]
Average Metric: 17.00 / 21 (81.0%):  80%|████████  | 20/25 [00:06<00:01,  3.42it/s]
Average Metric: 17.00 / 21 (81.0%):  84%|████████▍ | 21/25 [00:06<00:00,  5.15it/s]
Average Metric: 18.00 / 22 (81.8%):  84%|████████▍ | 21/25 [00:06<00:00,  5.15it/s]
Average Metric: 18.00 / 22 (81.8%):  88%|████████▊ | 22/25 [00:06<00:00,  3.40it/s]
Average Metric: 19.00 / 23 (82.6%):  88%|████████▊ | 22/25 [00:06<00:00,  3.40it/s]
Average Metric: 19.00 / 23 (82.6%):  92%|█████████▏| 23/25 [00:06<00:00,  3.46it/s]
Average Metric: 20.00 / 24 (83.3%):  92%|█████████▏| 23/25 [00:06<00:00,  3.46it/s]
Average Metric: 21.00 / 25 (84.0%):  96%|█████████▌| 24/25 [00:07<00:00,  3.46it/s]
Average Metric: 21.00 / 25 (84.0%): 100%|██████████| 25/25 [00:07<00:00,  2.68it/s]
Average Metric: 21.00 / 25 (84.0%): 100%|██████████| 25/25 [00:07<00:00,  3.14it/s]
2025/04/28 17:14:46 INFO dspy.evaluate.evaluate: Average Metric: 21 / 25 (84.0%)
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 84.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 0', 'Predictor 0: Few-Shot Set 1'].
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [80.0, 76.0, 72.0, 80.0, 68.0, 84.0]
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: ===== Trial 8 / 8 - Full Evaluation =====
2025/04/28 17:14:46 INFO dspy.teleprompt.mipro_optimizer_v2: Doing full eval on next top averaging program (Avg Score: 84.0) from minibatch trials...
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/100 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/100 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/100 [00:01<01:57,  1.19s/it]
Average Metric: 1.00 / 2 (50.0%):   1%|          | 1/100 [00:01<01:57,  1.19s/it] 
Average Metric: 1.00 / 2 (50.0%):   2%|▏         | 2/100 [00:01<01:08,  1.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 3 (66.7%):   2%|▏         | 2/100 [00:01<01:08,  1.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 4 (75.0%):   3%|▎         | 3/100 [00:02<01:07,  1.43it/s]
Average Metric: 3.00 / 4 (75.0%):   4%|▍         | 4/100 [00:02<00:40,  2.39it/s]
Average Metric: 4.00 / 5 (80.0%):   4%|▍         | 4/100 [00:02<00:40,  2.39it/s]
Average Metric: 4.00 / 6 (66.7%):   5%|▌         | 5/100 [00:02<00:39,  2.39it/s]
Average Metric: 4.00 / 6 (66.7%):   6%|▌         | 6/100 [00:02<00:26,  3.59it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 7 (71.4%):   6%|▌         | 6/100 [00:02<00:26,  3.59it/s]
Average Metric: 5.00 / 7 (71.4%):   7%|▋         | 7/100 [00:02<00:24,  3.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 6.00 / 8 (75.0%):   7%|▋         | 7/100 [00:03<00:24,  3.86it/s]
Average Metric: 6.00 / 8 (75.0%):   8%|▊         | 8/100 [00:03<00:47,  1.95it/s]  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):   8%|▊         | 8/100 [00:03<00:47,  1.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 10 (80.0%):   9%|▉         | 9/100 [00:03<00:46,  1.95it/s]
Average Metric: 8.00 / 10 (80.0%):  10%|█         | 10/100 [00:03<00:31,  2.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 11 (81.8%):  10%|█         | 10/100 [00:04<00:31,  2.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 12 (83.3%):  11%|█         | 11/100 [00:04<00:31,  2.83it/s]
Average Metric: 10.00 / 12 (83.3%):  12%|█▏        | 12/100 [00:04<00:25,  3.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 13 (84.6%):  12%|█▏        | 12/100 [00:04<00:25,  3.40it/s]
Average Metric: 11.00 / 13 (84.6%):  13%|█▎        | 13/100 [00:04<00:23,  3.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 14 (78.6%):  13%|█▎        | 13/100 [00:05<00:23,  3.65it/s]
Average Metric: 11.00 / 14 (78.6%):  14%|█▍        | 14/100 [00:05<00:28,  3.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  14%|█▍        | 14/100 [00:05<00:28,  3.06it/s]
Average Metric: 11.00 / 15 (73.3%):  15%|█▌        | 15/100 [00:05<00:33,  2.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  15%|█▌        | 15/100 [00:05<00:33,  2.52it/s]
Average Metric: 12.00 / 16 (75.0%):  16%|█▌        | 16/100 [00:05<00:28,  2.90it/s]
Average Metric: 12.00 / 17 (70.6%):  16%|█▌        | 16/100 [00:06<00:28,  2.90it/s]
Average Metric: 12.00 / 17 (70.6%):  17%|█▋        | 17/100 [00:06<00:34,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 18 (66.7%):  17%|█▋        | 17/100 [00:06<00:34,  2.43it/s]
Average Metric: 12.00 / 18 (66.7%):  18%|█▊        | 18/100 [00:06<00:29,  2.79it/s]
Average Metric: 13.00 / 19 (68.4%):  18%|█▊        | 18/100 [00:07<00:29,  2.79it/s]
Average Metric: 13.00 / 19 (68.4%):  19%|█▉        | 19/100 [00:07<00:30,  2.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 20 (70.0%):  19%|█▉        | 19/100 [00:07<00:30,  2.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 21 (71.4%):  20%|██        | 20/100 [00:07<00:30,  2.62it/s]
Average Metric: 15.00 / 21 (71.4%):  21%|██        | 21/100 [00:07<00:19,  4.09it/s]
Average Metric: 15.00 / 22 (68.2%):  21%|██        | 21/100 [00:07<00:19,  4.09it/s]
Average Metric: 15.00 / 22 (68.2%):  22%|██▏       | 22/100 [00:07<00:25,  3.04it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 23 (69.6%):  22%|██▏       | 22/100 [00:08<00:25,  3.04it/s]
Average Metric: 16.00 / 23 (69.6%):  23%|██▎       | 23/100 [00:08<00:40,  1.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 24 (66.7%):  23%|██▎       | 23/100 [00:09<00:40,  1.92it/s]
Average Metric: 16.00 / 24 (66.7%):  24%|██▍       | 24/100 [00:09<00:35,  2.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 25 (68.0%):  24%|██▍       | 24/100 [00:09<00:35,  2.17it/s]
Average Metric: 18.00 / 26 (69.2%):  25%|██▌       | 25/100 [00:09<00:34,  2.17it/s]
Average Metric: 18.00 / 26 (69.2%):  26%|██▌       | 26/100 [00:09<00:21,  3.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 27 (70.4%):  26%|██▌       | 26/100 [00:09<00:21,  3.47it/s]
Average Metric: 20.00 / 28 (71.4%):  27%|██▋       | 27/100 [00:10<00:21,  3.47it/s]
Average Metric: 20.00 / 28 (71.4%):  28%|██▊       | 28/100 [00:10<00:30,  2.35it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 29 (72.4%):  28%|██▊       | 28/100 [00:11<00:30,  2.35it/s]
Average Metric: 21.00 / 29 (72.4%):  29%|██▉       | 29/100 [00:11<00:32,  2.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 30 (73.3%):  29%|██▉       | 29/100 [00:11<00:32,  2.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 31 (71.0%):  30%|███       | 30/100 [00:11<00:31,  2.21it/s]
Average Metric: 22.00 / 31 (71.0%):  31%|███       | 31/100 [00:11<00:23,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 32 (68.8%):  31%|███       | 31/100 [00:12<00:23,  2.96it/s]
Average Metric: 22.00 / 32 (68.8%):  32%|███▏      | 32/100 [00:12<00:28,  2.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 23.00 / 33 (69.7%):  32%|███▏      | 32/100 [00:12<00:28,  2.37it/s]
Average Metric: 23.00 / 33 (69.7%):  33%|███▎      | 33/100 [00:12<00:29,  2.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 34 (70.6%):  33%|███▎      | 33/100 [00:12<00:29,  2.27it/s]
Average Metric: 24.00 / 34 (70.6%):  34%|███▍      | 34/100 [00:12<00:25,  2.64it/s]
Average Metric: 25.00 / 35 (71.4%):  34%|███▍      | 34/100 [00:13<00:25,  2.64it/s]
Average Metric: 25.00 / 35 (71.4%):  35%|███▌      | 35/100 [00:13<00:27,  2.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 36 (72.2%):  35%|███▌      | 35/100 [00:14<00:27,  2.37it/s]
Average Metric: 26.00 / 36 (72.2%):  36%|███▌      | 36/100 [00:14<00:34,  1.88it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 37 (73.0%):  36%|███▌      | 36/100 [00:14<00:34,  1.88it/s]
Average Metric: 27.00 / 37 (73.0%):  37%|███▋      | 37/100 [00:14<00:26,  2.36it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 28.00 / 38 (73.7%):  37%|███▋      | 37/100 [00:15<00:26,  2.36it/s]
Average Metric: 28.00 / 38 (73.7%):  38%|███▊      | 38/100 [00:15<00:34,  1.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 39 (74.4%):  38%|███▊      | 38/100 [00:15<00:34,  1.81it/s]
Average Metric: 29.00 / 39 (74.4%):  39%|███▉      | 39/100 [00:15<00:30,  2.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 30.00 / 40 (75.0%):  39%|███▉      | 39/100 [00:15<00:30,  2.03it/s]
Average Metric: 30.00 / 40 (75.0%):  40%|████      | 40/100 [00:15<00:24,  2.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 41 (75.6%):  40%|████      | 40/100 [00:16<00:24,  2.46it/s]
Average Metric: 31.00 / 41 (75.6%):  41%|████      | 41/100 [00:16<00:21,  2.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 31.00 / 42 (73.8%):  41%|████      | 41/100 [00:16<00:21,  2.80it/s]
Average Metric: 31.00 / 42 (73.8%):  42%|████▏     | 42/100 [00:16<00:24,  2.39it/s]  _warn_reuse()

Average Metric: 31.00 / 43 (72.1%):  42%|████▏     | 42/100 [00:17<00:24,  2.39it/s]
Average Metric: 31.00 / 43 (72.1%):  43%|████▎     | 43/100 [00:17<00:27,  2.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 44 (72.7%):  43%|████▎     | 43/100 [00:17<00:27,  2.08it/s]
Average Metric: 32.00 / 44 (72.7%):  44%|████▍     | 44/100 [00:17<00:21,  2.64it/s]
Average Metric: 33.00 / 45 (73.3%):  44%|████▍     | 44/100 [00:18<00:21,  2.64it/s]
Average Metric: 33.00 / 45 (73.3%):  45%|████▌     | 45/100 [00:18<00:25,  2.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 46 (73.9%):  45%|████▌     | 45/100 [00:18<00:25,  2.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 47 (74.5%):  46%|████▌     | 46/100 [00:18<00:25,  2.13it/s]
Average Metric: 35.00 / 47 (74.5%):  47%|████▋     | 47/100 [00:18<00:19,  2.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 48 (75.0%):  47%|████▋     | 47/100 [00:19<00:19,  2.66it/s]
Average Metric: 36.00 / 48 (75.0%):  48%|████▊     | 48/100 [00:19<00:20,  2.59it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 49 (75.5%):  48%|████▊     | 48/100 [00:19<00:20,  2.59it/s]
Average Metric: 37.00 / 49 (75.5%):  49%|████▉     | 49/100 [00:19<00:17,  2.88it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 50 (76.0%):  49%|████▉     | 49/100 [00:19<00:17,  2.88it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 51 (76.5%):  50%|█████     | 50/100 [00:19<00:17,  2.88it/s]
Average Metric: 39.00 / 51 (76.5%):  51%|█████     | 51/100 [00:19<00:11,  4.10it/s]
Average Metric: 40.00 / 52 (76.9%):  51%|█████     | 51/100 [00:19<00:11,  4.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 53 (77.4%):  52%|█████▏    | 52/100 [00:20<00:11,  4.10it/s]
Average Metric: 41.00 / 53 (77.4%):  53%|█████▎    | 53/100 [00:20<00:14,  3.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 54 (77.8%):  53%|█████▎    | 53/100 [00:20<00:14,  3.17it/s]
Average Metric: 42.00 / 54 (77.8%):  54%|█████▍    | 54/100 [00:20<00:15,  2.99it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 55 (76.4%):  54%|█████▍    | 54/100 [00:21<00:15,  2.99it/s]
Average Metric: 42.00 / 55 (76.4%):  55%|█████▌    | 55/100 [00:21<00:14,  3.14it/s]
Average Metric: 43.00 / 56 (76.8%):  55%|█████▌    | 55/100 [00:21<00:14,  3.14it/s]
Average Metric: 43.00 / 56 (76.8%):  56%|█████▌    | 56/100 [00:21<00:11,  3.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 57 (77.2%):  56%|█████▌    | 56/100 [00:21<00:11,  3.69it/s]
Average Metric: 44.00 / 57 (77.2%):  57%|█████▋    | 57/100 [00:21<00:10,  4.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 58 (75.9%):  57%|█████▋    | 57/100 [00:21<00:10,  4.23it/s]
Average Metric: 44.00 / 58 (75.9%):  58%|█████▊    | 58/100 [00:21<00:09,  4.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 45.00 / 59 (76.3%):  58%|█████▊    | 58/100 [00:22<00:09,  4.66it/s]
Average Metric: 45.00 / 59 (76.3%):  59%|█████▉    | 59/100 [00:22<00:12,  3.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 60 (76.7%):  59%|█████▉    | 59/100 [00:22<00:12,  3.33it/s]
Average Metric: 46.00 / 60 (76.7%):  60%|██████    | 60/100 [00:22<00:13,  2.86it/s]
Average Metric: 47.00 / 61 (77.0%):  60%|██████    | 60/100 [00:22<00:13,  2.86it/s]
Average Metric: 47.00 / 61 (77.0%):  61%|██████    | 61/100 [00:22<00:11,  3.26it/s]
Average Metric: 48.00 / 62 (77.4%):  61%|██████    | 61/100 [00:22<00:11,  3.26it/s]
Average Metric: 48.00 / 62 (77.4%):  62%|██████▏   | 62/100 [00:22<00:11,  3.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 63 (77.8%):  62%|██████▏   | 62/100 [00:23<00:11,  3.39it/s]
Average Metric: 49.00 / 63 (77.8%):  63%|██████▎   | 63/100 [00:23<00:08,  4.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 64 (78.1%):  63%|██████▎   | 63/100 [00:23<00:08,  4.21it/s]
Average Metric: 50.00 / 64 (78.1%):  64%|██████▍   | 64/100 [00:23<00:09,  3.77it/s]
Average Metric: 51.00 / 65 (78.5%):  64%|██████▍   | 64/100 [00:23<00:09,  3.77it/s]
Average Metric: 51.00 / 65 (78.5%):  65%|██████▌   | 65/100 [00:23<00:09,  3.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.

Average Metric: 52.00 / 66 (78.8%):  65%|██████▌   | 65/100 [00:24<00:09,  3.53it/s]
Average Metric: 52.00 / 66 (78.8%):  66%|██████▌   | 66/100 [00:24<00:13,  2.47it/s]  _warn_reuse()

Average Metric: 53.00 / 67 (79.1%):  66%|██████▌   | 66/100 [00:24<00:13,  2.47it/s]
Average Metric: 53.00 / 67 (79.1%):  67%|██████▋   | 67/100 [00:24<00:11,  2.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 68 (79.4%):  67%|██████▋   | 67/100 [00:24<00:11,  2.80it/s]
Average Metric: 54.00 / 68 (79.4%):  68%|██████▊   | 68/100 [00:24<00:10,  2.91it/s]
Average Metric: 55.00 / 69 (79.7%):  68%|██████▊   | 68/100 [00:25<00:10,  2.91it/s]
Average Metric: 55.00 / 69 (79.7%):  69%|██████▉   | 69/100 [00:25<00:13,  2.28it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 70 (80.0%):  69%|██████▉   | 69/100 [00:25<00:13,  2.28it/s]
Average Metric: 56.00 / 70 (80.0%):  70%|███████   | 70/100 [00:25<00:10,  2.83it/s]
Average Metric: 57.00 / 71 (80.3%):  70%|███████   | 70/100 [00:26<00:10,  2.83it/s]
Average Metric: 57.00 / 71 (80.3%):  71%|███████   | 71/100 [00:26<00:10,  2.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 58.00 / 72 (80.6%):  71%|███████   | 71/100 [00:26<00:10,  2.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 59.00 / 73 (80.8%):  72%|███████▏  | 72/100 [00:26<00:10,  2.69it/s]
Average Metric: 59.00 / 73 (80.8%):  73%|███████▎  | 73/100 [00:26<00:07,  3.55it/s]
Average Metric: 60.00 / 74 (81.1%):  73%|███████▎  | 73/100 [00:27<00:07,  3.55it/s]
Average Metric: 60.00 / 74 (81.1%):  74%|███████▍  | 74/100 [00:27<00:10,  2.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 60.00 / 75 (80.0%):  74%|███████▍  | 74/100 [00:27<00:10,  2.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 61.00 / 76 (80.3%):  75%|███████▌  | 75/100 [00:27<00:09,  2.57it/s]
Average Metric: 62.00 / 77 (80.5%):  76%|███████▌  | 76/100 [00:28<00:09,  2.57it/s]
Average Metric: 62.00 / 77 (80.5%):  77%|███████▋  | 77/100 [00:28<00:07,  2.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 78 (80.8%):  77%|███████▋  | 77/100 [00:28<00:07,  2.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 79 (79.7%):  78%|███████▊  | 78/100 [00:28<00:07,  2.94it/s]
Average Metric: 63.00 / 79 (79.7%):  79%|███████▉  | 79/100 [00:28<00:05,  3.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 64.00 / 80 (80.0%):  79%|███████▉  | 79/100 [00:29<00:05,  3.75it/s]
Average Metric: 64.00 / 80 (80.0%):  80%|████████  | 80/100 [00:29<00:07,  2.79it/s]
Average Metric: 65.00 / 81 (80.2%):  80%|████████  | 80/100 [00:29<00:07,  2.79it/s]
Average Metric: 65.00 / 81 (80.2%):  81%|████████  | 81/100 [00:29<00:06,  2.98it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 66.00 / 82 (80.5%):  81%|████████  | 81/100 [00:29<00:06,  2.98it/s]
Average Metric: 66.00 / 82 (80.5%):  82%|████████▏ | 82/100 [00:29<00:06,  2.89it/s]
Average Metric: 67.00 / 83 (80.7%):  82%|████████▏ | 82/100 [00:29<00:06,  2.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 84 (81.0%):  83%|████████▎ | 83/100 [00:29<00:05,  2.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 69.00 / 85 (81.2%):  84%|████████▍ | 84/100 [00:30<00:05,  2.89it/s]
Average Metric: 69.00 / 85 (81.2%):  85%|████████▌ | 85/100 [00:30<00:04,  3.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 70.00 / 86 (81.4%):  85%|████████▌ | 85/100 [00:30<00:04,  3.52it/s]
Average Metric: 70.00 / 86 (81.4%):  86%|████████▌ | 86/100 [00:30<00:04,  3.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 71.00 / 87 (81.6%):  86%|████████▌ | 86/100 [00:31<00:04,  3.19it/s]
Average Metric: 71.00 / 87 (81.6%):  87%|████████▋ | 87/100 [00:31<00:04,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 72.00 / 88 (81.8%):  87%|████████▋ | 87/100 [00:31<00:04,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 73.00 / 89 (82.0%):  88%|████████▊ | 88/100 [00:31<00:03,  3.18it/s]
Average Metric: 73.00 / 89 (82.0%):  89%|████████▉ | 89/100 [00:31<00:02,  4.24it/s]
Average Metric: 74.00 / 90 (82.2%):  89%|████████▉ | 89/100 [00:31<00:02,  4.24it/s]
Average Metric: 74.00 / 90 (82.2%):  90%|█████████ | 90/100 [00:31<00:02,  3.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 74.00 / 91 (81.3%):  90%|█████████ | 90/100 [00:31<00:02,  3.89it/s]
Average Metric: 74.00 / 91 (81.3%):  91%|█████████ | 91/100 [00:31<00:02,  4.45it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 75.00 / 92 (81.5%):  91%|█████████ | 91/100 [00:32<00:02,  4.45it/s]
Average Metric: 75.00 / 92 (81.5%):  92%|█████████▏| 92/100 [00:32<00:02,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 76.00 / 93 (81.7%):  92%|█████████▏| 92/100 [00:32<00:02,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 77.00 / 94 (81.9%):  93%|█████████▎| 93/100 [00:32<00:02,  2.96it/s]
Average Metric: 77.00 / 94 (81.9%):  94%|█████████▍| 94/100 [00:32<00:01,  4.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 78.00 / 95 (82.1%):  94%|█████████▍| 94/100 [00:32<00:01,  4.13it/s]
Average Metric: 79.00 / 96 (82.3%):  95%|█████████▌| 95/100 [00:33<00:01,  4.13it/s]
Average Metric: 79.00 / 96 (82.3%):  96%|█████████▌| 96/100 [00:33<00:01,  3.47it/s]
Average Metric: 79.00 / 97 (81.4%):  96%|█████████▌| 96/100 [00:33<00:01,  3.47it/s]
Average Metric: 79.00 / 97 (81.4%):  97%|█████████▋| 97/100 [00:33<00:00,  4.01it/s]
Average Metric: 80.00 / 98 (81.6%):  97%|█████████▋| 97/100 [00:34<00:00,  4.01it/s]
Average Metric: 80.00 / 98 (81.6%):  98%|█████████▊| 98/100 [00:34<00:00,  3.29it/s]
Average Metric: 81.00 / 99 (81.8%):  98%|█████████▊| 98/100 [00:34<00:00,  3.29it/s]
Average Metric: 81.00 / 99 (81.8%):  99%|█████████▉| 99/100 [00:34<00:00,  3.55it/s]2025/04/28 17:15:20 INFO dspy.evaluate.evaluate: Average Metric: 82 / 100 (82.0%)

Average Metric: 82.00 / 100 (82.0%):  99%|█████████▉| 99/100 [00:34<00:00,  3.55it/s]
Average Metric: 82.00 / 100 (82.0%): 100%|██████████| 100/100 [00:34<00:00,  2.92it/s]
2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: New best full eval score! Score: 82.0
2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0, 82.0]
2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 82.0
2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: =======================
2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: 

2025/04/28 17:15:20 INFO dspy.teleprompt.mipro_optimizer_v2: Returning best identified program with score 82.0!
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/130 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/130 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/130 [00:01<03:29,  1.63s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/130 [00:01<03:29,  1.63s/it]
Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/130 [00:01<03:28,  1.63s/it]
Average Metric: 3.00 / 4 (75.0%):   2%|▏         | 3/130 [00:01<03:26,  1.63s/it] 
Average Metric: 4.00 / 5 (80.0%):   3%|▎         | 4/130 [00:01<03:25,  1.63s/it]
Average Metric: 5.00 / 6 (83.3%):   4%|▍         | 5/130 [00:01<03:23,  1.63s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 7 (71.4%):   5%|▍         | 6/130 [00:01<03:21,  1.63s/it]
Average Metric: 6.00 / 8 (75.0%):   5%|▌         | 7/130 [00:01<03:20,  1.63s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 9 (66.7%):   6%|▌         | 8/130 [00:02<03:18,  1.63s/it]
Average Metric: 6.00 / 9 (66.7%):   7%|▋         | 9/130 [00:02<00:31,  3.83it/s]
Average Metric: 7.00 / 10 (70.0%):   7%|▋         | 9/130 [00:02<00:31,  3.83it/s]
Average Metric: 8.00 / 11 (72.7%):   8%|▊         | 10/130 [00:02<00:31,  3.83it/s]
Average Metric: 9.00 / 12 (75.0%):   8%|▊         | 11/130 [00:02<00:31,  3.83it/s]
Average Metric: 10.00 / 13 (76.9%):   9%|▉         | 12/130 [00:02<00:30,  3.83it/s]
Average Metric: 11.00 / 14 (78.6%):  10%|█         | 13/130 [00:02<00:30,  3.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 15 (80.0%):  11%|█         | 14/130 [00:02<00:30,  3.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 16 (81.2%):  12%|█▏        | 15/130 [00:03<00:30,  3.83it/s]
Average Metric: 13.00 / 16 (81.2%):  12%|█▏        | 16/130 [00:03<00:18,  6.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 17 (82.4%):  12%|█▏        | 16/130 [00:03<00:18,  6.25it/s]
Average Metric: 14.00 / 18 (77.8%):  13%|█▎        | 17/130 [00:03<00:18,  6.25it/s]
Average Metric: 15.00 / 19 (78.9%):  14%|█▍        | 18/130 [00:03<00:17,  6.25it/s]
Average Metric: 16.00 / 20 (80.0%):  15%|█▍        | 19/130 [00:03<00:17,  6.25it/s]
Average Metric: 17.00 / 21 (81.0%):  15%|█▌        | 20/130 [00:03<00:17,  6.25it/s]
Average Metric: 17.00 / 21 (81.0%):  16%|█▌        | 21/130 [00:03<00:12,  8.75it/s]
Average Metric: 18.00 / 22 (81.8%):  16%|█▌        | 21/130 [00:03<00:12,  8.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 23 (82.6%):  17%|█▋        | 22/130 [00:04<00:12,  8.75it/s]
Average Metric: 19.00 / 23 (82.6%):  18%|█▊        | 23/130 [00:04<00:15,  6.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 24 (79.2%):  18%|█▊        | 23/130 [00:04<00:15,  6.72it/s]
Average Metric: 20.00 / 25 (80.0%):  18%|█▊        | 24/130 [00:04<00:15,  6.72it/s]
Average Metric: 20.00 / 25 (80.0%):  19%|█▉        | 25/130 [00:04<00:17,  5.89it/s]
Average Metric: 21.00 / 26 (80.8%):  19%|█▉        | 25/130 [00:04<00:17,  5.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 27 (81.5%):  20%|██        | 26/130 [00:04<00:17,  5.89it/s]
Average Metric: 23.00 / 28 (82.1%):  21%|██        | 27/130 [00:04<00:17,  5.89it/s]
Average Metric: 23.00 / 28 (82.1%):  22%|██▏       | 28/130 [00:04<00:13,  7.61it/s]
Average Metric: 24.00 / 29 (82.8%):  22%|██▏       | 28/130 [00:04<00:13,  7.61it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 30 (80.0%):  22%|██▏       | 29/130 [00:05<00:13,  7.61it/s]
Average Metric: 24.00 / 30 (80.0%):  23%|██▎       | 30/130 [00:05<00:13,  7.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 31 (80.6%):  23%|██▎       | 30/130 [00:05<00:13,  7.30it/s]
Average Metric: 25.00 / 32 (78.1%):  24%|██▍       | 31/130 [00:05<00:13,  7.30it/s]
Average Metric: 25.00 / 32 (78.1%):  25%|██▍       | 32/130 [00:05<00:11,  8.49it/s]
Average Metric: 25.00 / 33 (75.8%):  25%|██▍       | 32/130 [00:05<00:11,  8.49it/s]
Average Metric: 26.00 / 34 (76.5%):  25%|██▌       | 33/130 [00:05<00:11,  8.49it/s]
Average Metric: 27.00 / 35 (77.1%):  26%|██▌       | 34/130 [00:05<00:11,  8.49it/s]
Average Metric: 27.00 / 35 (77.1%):  27%|██▋       | 35/130 [00:05<00:08, 11.14it/s]
Average Metric: 28.00 / 36 (77.8%):  27%|██▋       | 35/130 [00:05<00:08, 11.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 37 (78.4%):  28%|██▊       | 36/130 [00:05<00:08, 11.14it/s]
Average Metric: 29.00 / 37 (78.4%):  28%|██▊       | 37/130 [00:05<00:09,  9.95it/s]
Average Metric: 29.00 / 38 (76.3%):  28%|██▊       | 37/130 [00:05<00:09,  9.95it/s]
Average Metric: 29.00 / 39 (74.4%):  29%|██▉       | 38/130 [00:05<00:09,  9.95it/s]
Average Metric: 29.00 / 39 (74.4%):  30%|███       | 39/130 [00:05<00:11,  8.16it/s]
Average Metric: 30.00 / 40 (75.0%):  30%|███       | 39/130 [00:05<00:11,  8.16it/s]
Average Metric: 31.00 / 41 (75.6%):  31%|███       | 40/130 [00:05<00:11,  8.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 42 (76.2%):  32%|███▏      | 41/130 [00:06<00:10,  8.16it/s]
Average Metric: 32.00 / 42 (76.2%):  32%|███▏      | 42/130 [00:06<00:09,  8.90it/s]
Average Metric: 33.00 / 43 (76.7%):  32%|███▏      | 42/130 [00:06<00:09,  8.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 44 (77.3%):  33%|███▎      | 43/130 [00:06<00:09,  8.90it/s]
Average Metric: 34.00 / 44 (77.3%):  34%|███▍      | 44/130 [00:06<00:15,  5.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 45 (77.8%):  34%|███▍      | 44/130 [00:07<00:15,  5.57it/s]
Average Metric: 35.00 / 45 (77.8%):  35%|███▍      | 45/130 [00:07<00:17,  4.74it/s]
Average Metric: 36.00 / 46 (78.3%):  35%|███▍      | 45/130 [00:07<00:17,  4.74it/s]
Average Metric: 37.00 / 47 (78.7%):  35%|███▌      | 46/130 [00:07<00:17,  4.74it/s]
Average Metric: 38.00 / 48 (79.2%):  36%|███▌      | 47/130 [00:07<00:17,  4.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 49 (79.6%):  37%|███▋      | 48/130 [00:07<00:17,  4.74it/s]
Average Metric: 39.00 / 49 (79.6%):  38%|███▊      | 49/130 [00:07<00:10,  7.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 50 (80.0%):  38%|███▊      | 49/130 [00:07<00:10,  7.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 51 (80.4%):  38%|███▊      | 50/130 [00:07<00:10,  7.74it/s]
Average Metric: 41.00 / 51 (80.4%):  39%|███▉      | 51/130 [00:07<00:09,  8.06it/s]
Average Metric: 42.00 / 52 (80.8%):  39%|███▉      | 51/130 [00:07<00:09,  8.06it/s]
Average Metric: 43.00 / 53 (81.1%):  40%|████      | 52/130 [00:08<00:09,  8.06it/s]
Average Metric: 43.00 / 53 (81.1%):  41%|████      | 53/130 [00:08<00:13,  5.58it/s]
Average Metric: 43.00 / 54 (79.6%):  41%|████      | 53/130 [00:08<00:13,  5.58it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 55 (78.2%):  42%|████▏     | 54/130 [00:08<00:13,  5.58it/s]
Average Metric: 44.00 / 56 (78.6%):  42%|████▏     | 55/130 [00:08<00:13,  5.58it/s]
Average Metric: 44.00 / 56 (78.6%):  43%|████▎     | 56/130 [00:08<00:09,  7.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 45.00 / 57 (78.9%):  43%|████▎     | 56/130 [00:08<00:09,  7.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 58 (79.3%):  44%|████▍     | 57/130 [00:09<00:09,  7.83it/s]
Average Metric: 46.00 / 58 (79.3%):  45%|████▍     | 58/130 [00:09<00:13,  5.53it/s]
Average Metric: 47.00 / 59 (79.7%):  45%|████▍     | 58/130 [00:09<00:13,  5.53it/s]
Average Metric: 48.00 / 60 (80.0%):  45%|████▌     | 59/130 [00:09<00:12,  5.53it/s]
Average Metric: 49.00 / 61 (80.3%):  46%|████▌     | 60/130 [00:09<00:12,  5.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 62 (80.6%):  47%|████▋     | 61/130 [00:09<00:12,  5.53it/s]
Average Metric: 51.00 / 63 (81.0%):  48%|████▊     | 62/130 [00:09<00:12,  5.53it/s]
Average Metric: 51.00 / 64 (79.7%):  48%|████▊     | 63/130 [00:09<00:12,  5.53it/s]
Average Metric: 52.00 / 65 (80.0%):  49%|████▉     | 64/130 [00:09<00:11,  5.53it/s]
Average Metric: 52.00 / 65 (80.0%):  50%|█████     | 65/130 [00:09<00:06,  9.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 66 (80.3%):  50%|█████     | 65/130 [00:09<00:06,  9.87it/s]
Average Metric: 53.00 / 67 (79.1%):  51%|█████     | 66/130 [00:10<00:06,  9.87it/s]
Average Metric: 53.00 / 67 (79.1%):  52%|█████▏    | 67/130 [00:10<00:08,  7.03it/s]
Average Metric: 54.00 / 68 (79.4%):  52%|█████▏    | 67/130 [00:10<00:08,  7.03it/s]
Average Metric: 55.00 / 69 (79.7%):  52%|█████▏    | 68/130 [00:10<00:08,  7.03it/s]
Average Metric: 56.00 / 70 (80.0%):  53%|█████▎    | 69/130 [00:10<00:08,  7.03it/s]
Average Metric: 56.00 / 71 (78.9%):  54%|█████▍    | 70/130 [00:10<00:08,  7.03it/s]
Average Metric: 57.00 / 72 (79.2%):  55%|█████▍    | 71/130 [00:10<00:08,  7.03it/s]
Average Metric: 57.00 / 72 (79.2%):  55%|█████▌    | 72/130 [00:10<00:06,  8.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 57.00 / 73 (78.1%):  55%|█████▌    | 72/130 [00:11<00:06,  8.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 58.00 / 74 (78.4%):  56%|█████▌    | 73/130 [00:11<00:06,  8.33it/s]
Average Metric: 58.00 / 74 (78.4%):  57%|█████▋    | 74/130 [00:11<00:08,  6.45it/s]
Average Metric: 59.00 / 75 (78.7%):  57%|█████▋    | 74/130 [00:11<00:08,  6.45it/s]
Average Metric: 60.00 / 76 (78.9%):  58%|█████▊    | 75/130 [00:11<00:08,  6.45it/s]
Average Metric: 61.00 / 77 (79.2%):  58%|█████▊    | 76/130 [00:11<00:08,  6.45it/s]
Average Metric: 62.00 / 78 (79.5%):  59%|█████▉    | 77/130 [00:11<00:08,  6.45it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 79 (78.5%):  60%|██████    | 78/130 [00:11<00:08,  6.45it/s]
Average Metric: 62.00 / 79 (78.5%):  61%|██████    | 79/130 [00:11<00:06,  8.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 80 (77.5%):  61%|██████    | 79/130 [00:12<00:06,  8.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 81 (77.8%):  62%|██████▏   | 80/130 [00:12<00:06,  8.18it/s]
Average Metric: 63.00 / 81 (77.8%):  62%|██████▏   | 81/130 [00:12<00:10,  4.52it/s]
Average Metric: 64.00 / 82 (78.0%):  62%|██████▏   | 81/130 [00:12<00:10,  4.52it/s]
Average Metric: 65.00 / 83 (78.3%):  63%|██████▎   | 82/130 [00:12<00:10,  4.52it/s]
Average Metric: 66.00 / 84 (78.6%):  64%|██████▍   | 83/130 [00:12<00:10,  4.52it/s]
Average Metric: 67.00 / 85 (78.8%):  65%|██████▍   | 84/130 [00:12<00:10,  4.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 86 (79.1%):  65%|██████▌   | 85/130 [00:12<00:09,  4.52it/s]
Average Metric: 68.00 / 86 (79.1%):  66%|██████▌   | 86/130 [00:12<00:06,  6.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 69.00 / 87 (79.3%):  66%|██████▌   | 86/130 [00:13<00:06,  6.72it/s]
Average Metric: 69.00 / 88 (78.4%):  67%|██████▋   | 87/130 [00:13<00:06,  6.72it/s]
Average Metric: 69.00 / 88 (78.4%):  68%|██████▊   | 88/130 [00:13<00:08,  5.20it/s]
Average Metric: 70.00 / 89 (78.7%):  68%|██████▊   | 88/130 [00:13<00:08,  5.20it/s]
Average Metric: 71.00 / 90 (78.9%):  68%|██████▊   | 89/130 [00:13<00:07,  5.20it/s]
Average Metric: 72.00 / 91 (79.1%):  69%|██████▉   | 90/130 [00:13<00:07,  5.20it/s]
Average Metric: 73.00 / 92 (79.3%):  70%|███████   | 91/130 [00:13<00:07,  5.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 73.00 / 93 (78.5%):  71%|███████   | 92/130 [00:13<00:07,  5.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 74.00 / 94 (78.7%):  72%|███████▏  | 93/130 [00:14<00:07,  5.20it/s]
Average Metric: 74.00 / 94 (78.7%):  72%|███████▏  | 94/130 [00:14<00:06,  5.19it/s]
Average Metric: 75.00 / 95 (78.9%):  72%|███████▏  | 94/130 [00:14<00:06,  5.19it/s]
Average Metric: 76.00 / 96 (79.2%):  73%|███████▎  | 95/130 [00:14<00:06,  5.19it/s]
Average Metric: 77.00 / 97 (79.4%):  74%|███████▍  | 96/130 [00:14<00:06,  5.19it/s]
Average Metric: 78.00 / 98 (79.6%):  75%|███████▍  | 97/130 [00:14<00:06,  5.19it/s]
Average Metric: 79.00 / 99 (79.8%):  75%|███████▌  | 98/130 [00:14<00:06,  5.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 80.00 / 100 (80.0%):  76%|███████▌  | 99/130 [00:14<00:05,  5.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 80.00 / 101 (79.2%):  77%|███████▋  | 100/130 [00:15<00:05,  5.19it/s]
Average Metric: 80.00 / 101 (79.2%):  78%|███████▊  | 101/130 [00:15<00:04,  6.47it/s]
Average Metric: 81.00 / 102 (79.4%):  78%|███████▊  | 101/130 [00:15<00:04,  6.47it/s]
Average Metric: 82.00 / 103 (79.6%):  78%|███████▊  | 102/130 [00:15<00:04,  6.47it/s]
Average Metric: 83.00 / 104 (79.8%):  79%|███████▉  | 103/130 [00:15<00:04,  6.47it/s]
Average Metric: 84.00 / 105 (80.0%):  80%|████████  | 104/130 [00:15<00:04,  6.47it/s]
Average Metric: 85.00 / 106 (80.2%):  81%|████████  | 105/130 [00:15<00:03,  6.47it/s]
Average Metric: 86.00 / 107 (80.4%):  82%|████████▏ | 106/130 [00:15<00:03,  6.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 87.00 / 108 (80.6%):  82%|████████▏ | 107/130 [00:16<00:03,  6.47it/s]
Average Metric: 87.00 / 108 (80.6%):  83%|████████▎ | 108/130 [00:16<00:03,  7.09it/s]
Average Metric: 88.00 / 109 (80.7%):  83%|████████▎ | 108/130 [00:16<00:03,  7.09it/s]
Average Metric: 89.00 / 110 (80.9%):  84%|████████▍ | 109/130 [00:16<00:02,  7.09it/s]
Average Metric: 90.00 / 111 (81.1%):  85%|████████▍ | 110/130 [00:16<00:02,  7.09it/s]
Average Metric: 91.00 / 112 (81.2%):  85%|████████▌ | 111/130 [00:16<00:02,  7.09it/s]
Average Metric: 92.00 / 113 (81.4%):  86%|████████▌ | 112/130 [00:16<00:02,  7.09it/s]
Average Metric: 93.00 / 114 (81.6%):  87%|████████▋ | 113/130 [00:16<00:02,  7.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 94.00 / 115 (81.7%):  88%|████████▊ | 114/130 [00:16<00:02,  7.09it/s]
Average Metric: 94.00 / 115 (81.7%):  88%|████████▊ | 115/130 [00:16<00:01,  8.58it/s]
Average Metric: 95.00 / 116 (81.9%):  88%|████████▊ | 115/130 [00:16<00:01,  8.58it/s]
Average Metric: 95.00 / 117 (81.2%):  89%|████████▉ | 116/130 [00:16<00:01,  8.58it/s]
Average Metric: 96.00 / 118 (81.4%):  90%|█████████ | 117/130 [00:16<00:01,  8.58it/s]
Average Metric: 96.00 / 119 (80.7%):  91%|█████████ | 118/130 [00:17<00:01,  8.58it/s]
Average Metric: 96.00 / 119 (80.7%):  92%|█████████▏| 119/130 [00:17<00:01,  9.45it/s]
Average Metric: 97.00 / 120 (80.8%):  92%|█████████▏| 119/130 [00:17<00:01,  9.45it/s]
Average Metric: 98.00 / 121 (81.0%):  92%|█████████▏| 120/130 [00:17<00:01,  9.45it/s]
Average Metric: 98.00 / 121 (81.0%):  93%|█████████▎| 121/130 [00:17<00:00,  9.86it/s]
Average Metric: 99.00 / 122 (81.1%):  93%|█████████▎| 121/130 [00:17<00:00,  9.86it/s]
Average Metric: 100.00 / 123 (81.3%):  94%|█████████▍| 122/130 [00:17<00:00,  9.86it/s]
Average Metric: 100.00 / 123 (81.3%):  95%|█████████▍| 123/130 [00:17<00:00,  9.34it/s]
Average Metric: 101.00 / 124 (81.5%):  95%|█████████▍| 123/130 [00:17<00:00,  9.34it/s]
Average Metric: 102.00 / 125 (81.6%):  95%|█████████▌| 124/130 [00:17<00:00,  9.34it/s]
Average Metric: 102.00 / 125 (81.6%):  96%|█████████▌| 125/130 [00:17<00:00,  8.73it/s]
Average Metric: 103.00 / 126 (81.7%):  96%|█████████▌| 125/130 [00:17<00:00,  8.73it/s]
Average Metric: 104.00 / 127 (81.9%):  97%|█████████▋| 126/130 [00:17<00:00,  8.73it/s]
Average Metric: 104.00 / 127 (81.9%):  98%|█████████▊| 127/130 [00:17<00:00,  9.80it/s]
Average Metric: 105.00 / 128 (82.0%):  98%|█████████▊| 127/130 [00:18<00:00,  9.80it/s]
Average Metric: 106.00 / 129 (82.2%):  98%|█████████▊| 128/130 [00:18<00:00,  9.80it/s]
Average Metric: 106.00 / 129 (82.2%):  99%|█████████▉| 129/130 [00:18<00:00, 10.17it/s]2025/04/28 17:15:38 INFO dspy.evaluate.evaluate: Average Metric: 107 / 130 (82.3%)

Average Metric: 107.00 / 130 (82.3%):  99%|█████████▉| 129/130 [00:18<00:00, 10.17it/s]
Average Metric: 107.00 / 130 (82.3%): 100%|██████████| 130/130 [00:18<00:00,  7.09it/s]
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/131 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/131 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/131 [00:01<04:07,  1.91s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/131 [00:01<04:07,  1.91s/it]
Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/131 [00:01<04:06,  1.91s/it]
Average Metric: 4.00 / 4 (100.0%):   2%|▏         | 3/131 [00:01<04:04,  1.91s/it]
Average Metric: 5.00 / 5 (100.0%):   3%|▎         | 4/131 [00:01<04:02,  1.91s/it]
Average Metric: 6.00 / 6 (100.0%):   4%|▍         | 5/131 [00:01<04:00,  1.91s/it]
Average Metric: 7.00 / 7 (100.0%):   5%|▍         | 6/131 [00:01<03:58,  1.91s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):   5%|▌         | 7/131 [00:02<03:56,  1.91s/it] 
Average Metric: 7.00 / 8 (87.5%):   6%|▌         | 8/131 [00:02<00:38,  3.22it/s]
Average Metric: 7.00 / 9 (77.8%):   6%|▌         | 8/131 [00:03<00:38,  3.22it/s]
Average Metric: 7.00 / 9 (77.8%):   7%|▋         | 9/131 [00:03<00:38,  3.21it/s]
Average Metric: 8.00 / 10 (80.0%):   7%|▋         | 9/131 [00:03<00:38,  3.21it/s]
Average Metric: 9.00 / 11 (81.8%):   8%|▊         | 10/131 [00:03<00:37,  3.21it/s]
Average Metric: 10.00 / 12 (83.3%):   8%|▊         | 11/131 [00:03<00:37,  3.21it/s]
Average Metric: 10.00 / 13 (76.9%):   9%|▉         | 12/131 [00:03<00:37,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 14 (78.6%):  10%|▉         | 13/131 [00:03<00:36,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 15 (80.0%):  11%|█         | 14/131 [00:04<00:36,  3.21it/s]
Average Metric: 12.00 / 15 (80.0%):  11%|█▏        | 15/131 [00:04<00:24,  4.72it/s]
Average Metric: 13.00 / 16 (81.2%):  11%|█▏        | 15/131 [00:04<00:24,  4.72it/s]
Average Metric: 13.00 / 17 (76.5%):  12%|█▏        | 16/131 [00:04<00:24,  4.72it/s]
Average Metric: 14.00 / 18 (77.8%):  13%|█▎        | 17/131 [00:04<00:24,  4.72it/s]
Average Metric: 15.00 / 19 (78.9%):  14%|█▎        | 18/131 [00:04<00:23,  4.72it/s]
Average Metric: 15.00 / 20 (75.0%):  15%|█▍        | 19/131 [00:04<00:23,  4.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 21 (76.2%):  15%|█▌        | 20/131 [00:04<00:23,  4.72it/s]
Average Metric: 16.00 / 22 (72.7%):  16%|█▌        | 21/131 [00:04<00:23,  4.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 23 (73.9%):  17%|█▋        | 22/131 [00:05<00:23,  4.72it/s]
Average Metric: 17.00 / 23 (73.9%):  18%|█▊        | 23/131 [00:05<00:18,  5.85it/s]
Average Metric: 18.00 / 24 (75.0%):  18%|█▊        | 23/131 [00:05<00:18,  5.85it/s]
Average Metric: 19.00 / 25 (76.0%):  18%|█▊        | 24/131 [00:05<00:18,  5.85it/s]
Average Metric: 20.00 / 26 (76.9%):  19%|█▉        | 25/131 [00:05<00:18,  5.85it/s]
Average Metric: 21.00 / 27 (77.8%):  20%|█▉        | 26/131 [00:05<00:17,  5.85it/s]
Average Metric: 22.00 / 28 (78.6%):  21%|██        | 27/131 [00:05<00:17,  5.85it/s]
Average Metric: 23.00 / 29 (79.3%):  21%|██▏       | 28/131 [00:05<00:17,  5.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 30 (80.0%):  22%|██▏       | 29/131 [00:06<00:17,  5.85it/s]
Average Metric: 24.00 / 30 (80.0%):  23%|██▎       | 30/131 [00:06<00:15,  6.33it/s]
Average Metric: 25.00 / 31 (80.6%):  23%|██▎       | 30/131 [00:06<00:15,  6.33it/s]
Average Metric: 26.00 / 32 (81.2%):  24%|██▎       | 31/131 [00:06<00:15,  6.33it/s]
Average Metric: 27.00 / 33 (81.8%):  24%|██▍       | 32/131 [00:06<00:15,  6.33it/s]
Average Metric: 28.00 / 34 (82.4%):  25%|██▌       | 33/131 [00:06<00:15,  6.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 35 (82.9%):  26%|██▌       | 34/131 [00:06<00:15,  6.33it/s]
Average Metric: 30.00 / 36 (83.3%):  27%|██▋       | 35/131 [00:06<00:15,  6.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 37 (83.8%):  27%|██▋       | 36/131 [00:07<00:15,  6.33it/s]
Average Metric: 31.00 / 37 (83.8%):  28%|██▊       | 37/131 [00:07<00:13,  6.83it/s]
Average Metric: 32.00 / 38 (84.2%):  28%|██▊       | 37/131 [00:07<00:13,  6.83it/s]
Average Metric: 32.00 / 39 (82.1%):  29%|██▉       | 38/131 [00:07<00:13,  6.83it/s]
Average Metric: 33.00 / 40 (82.5%):  30%|██▉       | 39/131 [00:07<00:13,  6.83it/s]
Average Metric: 34.00 / 41 (82.9%):  31%|███       | 40/131 [00:07<00:13,  6.83it/s]
Average Metric: 35.00 / 42 (83.3%):  31%|███▏      | 41/131 [00:07<00:13,  6.83it/s]
Average Metric: 36.00 / 43 (83.7%):  32%|███▏      | 42/131 [00:07<00:13,  6.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 44 (84.1%):  33%|███▎      | 43/131 [00:07<00:12,  6.83it/s]
Average Metric: 37.00 / 44 (84.1%):  34%|███▎      | 44/131 [00:07<00:09,  9.19it/s]
Average Metric: 38.00 / 45 (84.4%):  34%|███▎      | 44/131 [00:07<00:09,  9.19it/s]
Average Metric: 38.00 / 46 (82.6%):  34%|███▍      | 45/131 [00:07<00:09,  9.19it/s]
Average Metric: 38.00 / 46 (82.6%):  35%|███▌      | 46/131 [00:07<00:09,  8.56it/s]
Average Metric: 39.00 / 47 (83.0%):  35%|███▌      | 46/131 [00:07<00:09,  8.56it/s]
Average Metric: 40.00 / 48 (83.3%):  36%|███▌      | 47/131 [00:08<00:09,  8.56it/s]
Average Metric: 40.00 / 48 (83.3%):  37%|███▋      | 48/131 [00:08<00:12,  6.60it/s]
Average Metric: 41.00 / 49 (83.7%):  37%|███▋      | 48/131 [00:08<00:12,  6.60it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 50 (82.0%):  37%|███▋      | 49/131 [00:08<00:12,  6.60it/s]
Average Metric: 42.00 / 51 (82.4%):  38%|███▊      | 50/131 [00:08<00:12,  6.60it/s]
Average Metric: 42.00 / 51 (82.4%):  39%|███▉      | 51/131 [00:08<00:10,  7.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 52 (82.7%):  39%|███▉      | 51/131 [00:08<00:10,  7.71it/s]
Average Metric: 44.00 / 53 (83.0%):  40%|███▉      | 52/131 [00:08<00:10,  7.71it/s]
Average Metric: 44.00 / 53 (83.0%):  40%|████      | 53/131 [00:08<00:11,  7.03it/s]
Average Metric: 45.00 / 54 (83.3%):  40%|████      | 53/131 [00:08<00:11,  7.03it/s]
Average Metric: 46.00 / 55 (83.6%):  41%|████      | 54/131 [00:08<00:10,  7.03it/s]
Average Metric: 46.00 / 56 (82.1%):  42%|████▏     | 55/131 [00:08<00:10,  7.03it/s]
Average Metric: 47.00 / 57 (82.5%):  43%|████▎     | 56/131 [00:08<00:10,  7.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 58 (82.8%):  44%|████▎     | 57/131 [00:09<00:10,  7.03it/s]
Average Metric: 48.00 / 58 (82.8%):  44%|████▍     | 58/131 [00:09<00:09,  7.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 59 (81.4%):  44%|████▍     | 58/131 [00:10<00:09,  7.69it/s]
Average Metric: 48.00 / 59 (81.4%):  45%|████▌     | 59/131 [00:10<00:12,  5.76it/s]
Average Metric: 49.00 / 60 (81.7%):  45%|████▌     | 59/131 [00:10<00:12,  5.76it/s]
Average Metric: 50.00 / 61 (82.0%):  46%|████▌     | 60/131 [00:10<00:12,  5.76it/s]
Average Metric: 50.00 / 62 (80.6%):  47%|████▋     | 61/131 [00:10<00:12,  5.76it/s]
Average Metric: 50.00 / 63 (79.4%):  47%|████▋     | 62/131 [00:10<00:11,  5.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 64 (79.7%):  48%|████▊     | 63/131 [00:10<00:11,  5.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 52.00 / 65 (80.0%):  49%|████▉     | 64/131 [00:10<00:11,  5.76it/s]
Average Metric: 52.00 / 65 (80.0%):  50%|████▉     | 65/131 [00:10<00:08,  8.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 66 (80.3%):  50%|████▉     | 65/131 [00:10<00:08,  8.03it/s]
Average Metric: 53.00 / 66 (80.3%):  50%|█████     | 66/131 [00:10<00:08,  7.97it/s]
Average Metric: 53.00 / 67 (79.1%):  50%|█████     | 66/131 [00:10<00:08,  7.97it/s]
Average Metric: 53.00 / 68 (77.9%):  51%|█████     | 67/131 [00:10<00:08,  7.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 69 (76.8%):  52%|█████▏    | 68/131 [00:10<00:07,  7.97it/s]
Average Metric: 53.00 / 69 (76.8%):  53%|█████▎    | 69/131 [00:10<00:06,  9.31it/s]
Average Metric: 54.00 / 70 (77.1%):  53%|█████▎    | 69/131 [00:10<00:06,  9.31it/s]
Average Metric: 55.00 / 71 (77.5%):  53%|█████▎    | 70/131 [00:10<00:06,  9.31it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 72 (77.8%):  54%|█████▍    | 71/131 [00:10<00:06,  9.31it/s]
Average Metric: 56.00 / 72 (77.8%):  55%|█████▍    | 72/131 [00:10<00:05, 10.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 73 (76.7%):  55%|█████▍    | 72/131 [00:11<00:05, 10.50it/s]
Average Metric: 57.00 / 74 (77.0%):  56%|█████▌    | 73/131 [00:11<00:05, 10.50it/s]
Average Metric: 57.00 / 74 (77.0%):  56%|█████▋    | 74/131 [00:11<00:09,  5.86it/s]
Average Metric: 58.00 / 75 (77.3%):  56%|█████▋    | 74/131 [00:11<00:09,  5.86it/s]
Average Metric: 59.00 / 76 (77.6%):  57%|█████▋    | 75/131 [00:11<00:09,  5.86it/s]
Average Metric: 60.00 / 77 (77.9%):  58%|█████▊    | 76/131 [00:11<00:09,  5.86it/s]
Average Metric: 61.00 / 78 (78.2%):  59%|█████▉    | 77/131 [00:11<00:09,  5.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 79 (78.5%):  60%|█████▉    | 78/131 [00:12<00:09,  5.86it/s]
Average Metric: 62.00 / 79 (78.5%):  60%|██████    | 79/131 [00:12<00:07,  6.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 80 (78.8%):  60%|██████    | 79/131 [00:12<00:07,  6.85it/s]
Average Metric: 63.00 / 80 (78.8%):  61%|██████    | 80/131 [00:12<00:09,  5.18it/s]
Average Metric: 64.00 / 81 (79.0%):  61%|██████    | 80/131 [00:12<00:09,  5.18it/s]
Average Metric: 65.00 / 82 (79.3%):  62%|██████▏   | 81/131 [00:12<00:09,  5.18it/s]
Average Metric: 65.00 / 83 (78.3%):  63%|██████▎   | 82/131 [00:13<00:09,  5.18it/s]
Average Metric: 65.00 / 84 (77.4%):  63%|██████▎   | 83/131 [00:13<00:09,  5.18it/s]
Average Metric: 66.00 / 85 (77.6%):  64%|██████▍   | 84/131 [00:13<00:09,  5.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 67.00 / 86 (77.9%):  65%|██████▍   | 85/131 [00:13<00:08,  5.18it/s]
Average Metric: 67.00 / 86 (77.9%):  66%|██████▌   | 86/131 [00:13<00:05,  8.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 87 (78.2%):  66%|██████▌   | 86/131 [00:13<00:05,  8.44it/s]
Average Metric: 69.00 / 88 (78.4%):  66%|██████▋   | 87/131 [00:13<00:05,  8.44it/s]
Average Metric: 69.00 / 88 (78.4%):  67%|██████▋   | 88/131 [00:13<00:04,  8.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 70.00 / 89 (78.7%):  67%|██████▋   | 88/131 [00:13<00:04,  8.75it/s]
Average Metric: 71.00 / 90 (78.9%):  68%|██████▊   | 89/131 [00:13<00:04,  8.75it/s]
Average Metric: 71.00 / 90 (78.9%):  69%|██████▊   | 90/131 [00:13<00:04,  9.24it/s]
Average Metric: 71.00 / 91 (78.0%):  69%|██████▊   | 90/131 [00:13<00:04,  9.24it/s]
Average Metric: 72.00 / 92 (78.3%):  69%|██████▉   | 91/131 [00:13<00:04,  9.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 73.00 / 93 (78.5%):  70%|███████   | 92/131 [00:14<00:04,  9.24it/s]
Average Metric: 73.00 / 93 (78.5%):  71%|███████   | 93/131 [00:14<00:04,  8.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 74.00 / 94 (78.7%):  71%|███████   | 93/131 [00:14<00:04,  8.11it/s]
Average Metric: 74.00 / 95 (77.9%):  72%|███████▏  | 94/131 [00:14<00:04,  8.11it/s]
Average Metric: 74.00 / 95 (77.9%):  73%|███████▎  | 95/131 [00:14<00:05,  7.19it/s]
Average Metric: 74.00 / 96 (77.1%):  73%|███████▎  | 95/131 [00:14<00:05,  7.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 75.00 / 97 (77.3%):  73%|███████▎  | 96/131 [00:14<00:04,  7.19it/s]
Average Metric: 76.00 / 98 (77.6%):  74%|███████▍  | 97/131 [00:14<00:04,  7.19it/s]
Average Metric: 76.00 / 98 (77.6%):  75%|███████▍  | 98/131 [00:14<00:03,  9.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 77.00 / 99 (77.8%):  75%|███████▍  | 98/131 [00:14<00:03,  9.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 78.00 / 100 (78.0%):  76%|███████▌  | 99/131 [00:14<00:03,  9.48it/s]
Average Metric: 78.00 / 100 (78.0%):  76%|███████▋  | 100/131 [00:14<00:04,  7.50it/s]
Average Metric: 79.00 / 101 (78.2%):  76%|███████▋  | 100/131 [00:15<00:04,  7.50it/s]
Average Metric: 80.00 / 102 (78.4%):  77%|███████▋  | 101/131 [00:15<00:04,  7.50it/s]
Average Metric: 80.00 / 102 (78.4%):  78%|███████▊  | 102/131 [00:15<00:03,  8.22it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 81.00 / 103 (78.6%):  78%|███████▊  | 102/131 [00:15<00:03,  8.22it/s]
Average Metric: 82.00 / 104 (78.8%):  79%|███████▊  | 103/131 [00:15<00:03,  8.22it/s]
Average Metric: 83.00 / 105 (79.0%):  79%|███████▉  | 104/131 [00:15<00:03,  8.22it/s]
Average Metric: 84.00 / 106 (79.2%):  80%|████████  | 105/131 [00:15<00:03,  8.22it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 85.00 / 107 (79.4%):  81%|████████  | 106/131 [00:15<00:03,  8.22it/s]
Average Metric: 85.00 / 107 (79.4%):  82%|████████▏ | 107/131 [00:15<00:02, 10.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 86.00 / 108 (79.6%):  82%|████████▏ | 107/131 [00:16<00:02, 10.56it/s]
Average Metric: 86.00 / 109 (78.9%):  82%|████████▏ | 108/131 [00:16<00:02, 10.56it/s]
Average Metric: 86.00 / 109 (78.9%):  83%|████████▎ | 109/131 [00:16<00:03,  6.92it/s]
Average Metric: 87.00 / 110 (79.1%):  83%|████████▎ | 109/131 [00:16<00:03,  6.92it/s]
Average Metric: 88.00 / 111 (79.3%):  84%|████████▍ | 110/131 [00:16<00:03,  6.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 88.00 / 112 (78.6%):  85%|████████▍ | 111/131 [00:16<00:02,  6.92it/s]
Average Metric: 88.00 / 113 (77.9%):  85%|████████▌ | 112/131 [00:16<00:02,  6.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 89.00 / 114 (78.1%):  86%|████████▋ | 113/131 [00:16<00:02,  6.92it/s]
Average Metric: 89.00 / 114 (78.1%):  87%|████████▋ | 114/131 [00:16<00:01,  9.68it/s]
Average Metric: 89.00 / 115 (77.4%):  87%|████████▋ | 114/131 [00:16<00:01,  9.68it/s]
Average Metric: 90.00 / 116 (77.6%):  88%|████████▊ | 115/131 [00:16<00:01,  9.68it/s]
Average Metric: 91.00 / 117 (77.8%):  89%|████████▊ | 116/131 [00:16<00:01,  9.68it/s]
Average Metric: 92.00 / 118 (78.0%):  89%|████████▉ | 117/131 [00:16<00:01,  9.68it/s]
Average Metric: 92.00 / 119 (77.3%):  90%|█████████ | 118/131 [00:16<00:01,  9.68it/s]
Average Metric: 93.00 / 120 (77.5%):  91%|█████████ | 119/131 [00:16<00:01,  9.68it/s]
Average Metric: 93.00 / 120 (77.5%):  92%|█████████▏| 120/131 [00:16<00:00, 13.80it/s]
Average Metric: 94.00 / 121 (77.7%):  92%|█████████▏| 120/131 [00:16<00:00, 13.80it/s]
Average Metric: 95.00 / 122 (77.9%):  92%|█████████▏| 121/131 [00:17<00:00, 13.80it/s]
Average Metric: 95.00 / 122 (77.9%):  93%|█████████▎| 122/131 [00:17<00:00, 10.24it/s]
Average Metric: 95.00 / 123 (77.2%):  93%|█████████▎| 122/131 [00:17<00:00, 10.24it/s]
Average Metric: 96.00 / 124 (77.4%):  94%|█████████▍| 123/131 [00:17<00:00, 10.24it/s]
Average Metric: 96.00 / 124 (77.4%):  95%|█████████▍| 124/131 [00:17<00:00, 10.71it/s]
Average Metric: 97.00 / 125 (77.6%):  95%|█████████▍| 124/131 [00:17<00:00, 10.71it/s]
Average Metric: 97.00 / 126 (77.0%):  95%|█████████▌| 125/131 [00:17<00:00, 10.71it/s]
Average Metric: 97.00 / 126 (77.0%):  96%|█████████▌| 126/131 [00:17<00:00,  9.91it/s]
Average Metric: 98.00 / 127 (77.2%):  96%|█████████▌| 126/131 [00:17<00:00,  9.91it/s]
Average Metric: 99.00 / 128 (77.3%):  97%|█████████▋| 127/131 [00:17<00:00,  9.91it/s]
Average Metric: 99.00 / 128 (77.3%):  98%|█████████▊| 128/131 [00:17<00:00, 10.11it/s]
Average Metric: 100.00 / 129 (77.5%):  98%|█████████▊| 128/131 [00:17<00:00, 10.11it/s]
Average Metric: 101.00 / 130 (77.7%):  98%|█████████▊| 129/131 [00:17<00:00, 10.11it/s]
Average Metric: 101.00 / 130 (77.7%):  99%|█████████▉| 130/131 [00:17<00:00,  9.54it/s]
Average Metric: 102.00 / 131 (77.9%):  99%|█████████▉| 130/131 [00:18<00:00,  9.54it/s]
Average Metric: 102.00 / 131 (77.9%): 100%|██████████| 131/131 [00:18<00:00,  7.27it/s]
2025/04/28 17:15:57 INFO dspy.evaluate.evaluate: Average Metric: 102 / 131 (77.9%)
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/130 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 0.00 / 1 (0.0%):   0%|          | 0/130 [00:01<?, ?it/s]
Average Metric: 0.00 / 1 (0.0%):   1%|          | 1/130 [00:01<03:36,  1.68s/it]
Average Metric: 1.00 / 2 (50.0%):   1%|          | 1/130 [00:01<03:36,  1.68s/it]
Average Metric: 1.00 / 3 (33.3%):   2%|▏         | 2/130 [00:01<03:34,  1.68s/it]
Average Metric: 2.00 / 4 (50.0%):   2%|▏         | 3/130 [00:01<03:33,  1.68s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 5 (60.0%):   3%|▎         | 4/130 [00:01<03:31,  1.68s/it]
Average Metric: 3.00 / 6 (50.0%):   4%|▍         | 5/130 [00:01<03:29,  1.68s/it]
Average Metric: 4.00 / 7 (57.1%):   5%|▍         | 6/130 [00:01<03:28,  1.68s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):   5%|▌         | 7/130 [00:01<03:26,  1.68s/it]
Average Metric: 5.00 / 8 (62.5%):   6%|▌         | 8/130 [00:01<00:20,  5.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 9 (66.7%):   6%|▌         | 8/130 [00:01<00:20,  5.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 10 (70.0%):   7%|▋         | 9/130 [00:02<00:20,  5.87it/s]
Average Metric: 7.00 / 11 (63.6%):   8%|▊         | 10/130 [00:02<00:20,  5.87it/s]
Average Metric: 7.00 / 12 (58.3%):   8%|▊         | 11/130 [00:02<00:20,  5.87it/s]
Average Metric: 7.00 / 12 (58.3%):   9%|▉         | 12/130 [00:02<00:21,  5.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 13 (61.5%):   9%|▉         | 12/130 [00:02<00:21,  5.39it/s]
Average Metric: 9.00 / 14 (64.3%):  10%|█         | 13/130 [00:02<00:21,  5.39it/s]
Average Metric: 9.00 / 14 (64.3%):  11%|█         | 14/130 [00:02<00:21,  5.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 15 (60.0%):  11%|█         | 14/130 [00:03<00:21,  5.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 16 (62.5%):  12%|█▏        | 15/130 [00:03<00:21,  5.43it/s]
Average Metric: 11.00 / 17 (64.7%):  12%|█▏        | 16/130 [00:03<00:20,  5.43it/s]
Average Metric: 11.00 / 17 (64.7%):  13%|█▎        | 17/130 [00:03<00:15,  7.38it/s]
Average Metric: 12.00 / 18 (66.7%):  13%|█▎        | 17/130 [00:03<00:15,  7.38it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 19 (68.4%):  14%|█▍        | 18/130 [00:03<00:15,  7.38it/s]
Average Metric: 14.00 / 20 (70.0%):  15%|█▍        | 19/130 [00:03<00:15,  7.38it/s]
Average Metric: 14.00 / 20 (70.0%):  15%|█▌        | 20/130 [00:03<00:12,  8.92it/s]
Average Metric: 15.00 / 21 (71.4%):  15%|█▌        | 20/130 [00:03<00:12,  8.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 22 (68.2%):  16%|█▌        | 21/130 [00:03<00:12,  8.92it/s]
Average Metric: 15.00 / 22 (68.2%):  17%|█▋        | 22/130 [00:03<00:12,  8.95it/s]
Average Metric: 15.00 / 23 (65.2%):  17%|█▋        | 22/130 [00:03<00:12,  8.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 24 (62.5%):  18%|█▊        | 23/130 [00:03<00:11,  8.95it/s]
Average Metric: 15.00 / 24 (62.5%):  18%|█▊        | 24/130 [00:03<00:15,  7.05it/s]
Average Metric: 15.00 / 25 (60.0%):  18%|█▊        | 24/130 [00:03<00:15,  7.05it/s]
Average Metric: 15.00 / 26 (57.7%):  19%|█▉        | 25/130 [00:04<00:14,  7.05it/s]
Average Metric: 15.00 / 26 (57.7%):  20%|██        | 26/130 [00:04<00:16,  6.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 27 (59.3%):  20%|██        | 26/130 [00:04<00:16,  6.20it/s]
Average Metric: 16.00 / 27 (59.3%):  21%|██        | 27/130 [00:04<00:15,  6.49it/s]
Average Metric: 16.00 / 28 (57.1%):  21%|██        | 27/130 [00:04<00:15,  6.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 29 (58.6%):  22%|██▏       | 28/130 [00:04<00:15,  6.49it/s]
Average Metric: 17.00 / 29 (58.6%):  22%|██▏       | 29/130 [00:04<00:13,  7.55it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 30 (56.7%):  22%|██▏       | 29/130 [00:04<00:13,  7.55it/s]
Average Metric: 17.00 / 30 (56.7%):  23%|██▎       | 30/130 [00:04<00:14,  6.90it/s]
Average Metric: 17.00 / 31 (54.8%):  23%|██▎       | 30/130 [00:04<00:14,  6.90it/s]
Average Metric: 17.00 / 32 (53.1%):  24%|██▍       | 31/130 [00:04<00:14,  6.90it/s]
Average Metric: 17.00 / 33 (51.5%):  25%|██▍       | 32/130 [00:05<00:14,  6.90it/s]
Average Metric: 17.00 / 33 (51.5%):  25%|██▌       | 33/130 [00:05<00:10,  9.46it/s]
Average Metric: 17.00 / 34 (50.0%):  25%|██▌       | 33/130 [00:05<00:10,  9.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 35 (51.4%):  26%|██▌       | 34/130 [00:05<00:10,  9.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 36 (52.8%):  27%|██▋       | 35/130 [00:05<00:10,  9.46it/s]
Average Metric: 19.00 / 36 (52.8%):  28%|██▊       | 36/130 [00:05<00:08, 11.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 37 (51.4%):  28%|██▊       | 36/130 [00:05<00:08, 11.25it/s]
Average Metric: 19.00 / 38 (50.0%):  28%|██▊       | 37/130 [00:05<00:08, 11.25it/s]
Average Metric: 19.00 / 38 (50.0%):  29%|██▉       | 38/130 [00:05<00:07, 12.71it/s]
Average Metric: 19.00 / 39 (48.7%):  29%|██▉       | 38/130 [00:05<00:07, 12.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 40 (47.5%):  30%|███       | 39/130 [00:06<00:07, 12.71it/s]
Average Metric: 19.00 / 40 (47.5%):  31%|███       | 40/130 [00:06<00:13,  6.56it/s]
Average Metric: 19.00 / 41 (46.3%):  31%|███       | 40/130 [00:06<00:13,  6.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 42 (45.2%):  32%|███▏      | 41/130 [00:06<00:13,  6.56it/s]
Average Metric: 19.00 / 42 (45.2%):  32%|███▏      | 42/130 [00:06<00:12,  7.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 43 (44.2%):  32%|███▏      | 42/130 [00:06<00:12,  7.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 44 (45.5%):  33%|███▎      | 43/130 [00:06<00:12,  7.12it/s]
Average Metric: 20.00 / 44 (45.5%):  34%|███▍      | 44/130 [00:06<00:10,  7.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 45 (46.7%):  34%|███▍      | 44/130 [00:06<00:10,  7.90it/s]
Average Metric: 22.00 / 46 (47.8%):  35%|███▍      | 45/130 [00:06<00:10,  7.90it/s]
Average Metric: 22.00 / 46 (47.8%):  35%|███▌      | 46/130 [00:06<00:09,  9.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 47 (46.8%):  35%|███▌      | 46/130 [00:06<00:09,  9.17it/s]
Average Metric: 22.00 / 48 (45.8%):  36%|███▌      | 47/130 [00:06<00:09,  9.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 23.00 / 49 (46.9%):  37%|███▋      | 48/130 [00:06<00:08,  9.17it/s]
Average Metric: 23.00 / 49 (46.9%):  38%|███▊      | 49/130 [00:06<00:07, 11.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 50 (48.0%):  38%|███▊      | 49/130 [00:06<00:07, 11.14it/s]
Average Metric: 25.00 / 51 (49.0%):  38%|███▊      | 50/130 [00:06<00:07, 11.14it/s]
Average Metric: 25.00 / 51 (49.0%):  39%|███▉      | 51/130 [00:06<00:07, 10.91it/s]
Average Metric: 25.00 / 52 (48.1%):  39%|███▉      | 51/130 [00:06<00:07, 10.91it/s]
Average Metric: 26.00 / 53 (49.1%):  40%|████      | 52/130 [00:07<00:07, 10.91it/s]
Average Metric: 26.00 / 53 (49.1%):  41%|████      | 53/130 [00:07<00:11,  6.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 54 (50.0%):  41%|████      | 53/130 [00:07<00:11,  6.95it/s]
Average Metric: 27.00 / 54 (50.0%):  42%|████▏     | 54/130 [00:07<00:12,  5.92it/s]
Average Metric: 27.00 / 55 (49.1%):  42%|████▏     | 54/130 [00:07<00:12,  5.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 28.00 / 56 (50.0%):  42%|████▏     | 55/130 [00:07<00:12,  5.92it/s]
Average Metric: 29.00 / 57 (50.9%):  43%|████▎     | 56/130 [00:07<00:12,  5.92it/s]
Average Metric: 29.00 / 58 (50.0%):  44%|████▍     | 57/130 [00:07<00:12,  5.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 59 (49.2%):  45%|████▍     | 58/130 [00:08<00:12,  5.92it/s]
Average Metric: 29.00 / 59 (49.2%):  45%|████▌     | 59/130 [00:08<00:08,  8.59it/s]
Average Metric: 30.00 / 60 (50.0%):  45%|████▌     | 59/130 [00:08<00:08,  8.59it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 61 (50.8%):  46%|████▌     | 60/130 [00:08<00:08,  8.59it/s]
Average Metric: 31.00 / 61 (50.8%):  47%|████▋     | 61/130 [00:08<00:07,  9.10it/s]
Average Metric: 31.00 / 62 (50.0%):  47%|████▋     | 61/130 [00:08<00:07,  9.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 63 (49.2%):  48%|████▊     | 62/130 [00:08<00:07,  9.10it/s]
Average Metric: 32.00 / 64 (50.0%):  48%|████▊     | 63/130 [00:08<00:07,  9.10it/s]
Average Metric: 33.00 / 65 (50.8%):  49%|████▉     | 64/130 [00:08<00:07,  9.10it/s]
Average Metric: 33.00 / 66 (50.0%):  50%|█████     | 65/130 [00:08<00:07,  9.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 67 (49.3%):  51%|█████     | 66/130 [00:08<00:07,  9.10it/s]
Average Metric: 33.00 / 67 (49.3%):  52%|█████▏    | 67/130 [00:08<00:05, 12.50it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 68 (48.5%):  52%|█████▏    | 67/130 [00:09<00:05, 12.50it/s]
Average Metric: 34.00 / 69 (49.3%):  52%|█████▏    | 68/130 [00:09<00:04, 12.50it/s]
Average Metric: 34.00 / 69 (49.3%):  53%|█████▎    | 69/130 [00:09<00:09,  6.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 70 (48.6%):  53%|█████▎    | 69/130 [00:09<00:09,  6.51it/s]
Average Metric: 34.00 / 71 (47.9%):  54%|█████▍    | 70/130 [00:09<00:09,  6.51it/s]
Average Metric: 34.00 / 72 (47.2%):  55%|█████▍    | 71/130 [00:09<00:09,  6.51it/s]
Average Metric: 35.00 / 73 (47.9%):  55%|█████▌    | 72/130 [00:09<00:08,  6.51it/s]
Average Metric: 36.00 / 74 (48.6%):  56%|█████▌    | 73/130 [00:09<00:08,  6.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 75 (49.3%):  57%|█████▋    | 74/130 [00:10<00:08,  6.51it/s]
Average Metric: 37.00 / 75 (49.3%):  58%|█████▊    | 75/130 [00:10<00:06,  7.94it/s]
Average Metric: 38.00 / 76 (50.0%):  58%|█████▊    | 75/130 [00:10<00:06,  7.94it/s]
Average Metric: 38.00 / 77 (49.4%):  58%|█████▊    | 76/130 [00:10<00:06,  7.94it/s]
Average Metric: 38.00 / 78 (48.7%):  59%|█████▉    | 77/130 [00:10<00:06,  7.94it/s]
Average Metric: 38.00 / 79 (48.1%):  60%|██████    | 78/130 [00:10<00:06,  7.94it/s]
Average Metric: 39.00 / 80 (48.8%):  61%|██████    | 79/130 [00:10<00:06,  7.94it/s]
Average Metric: 40.00 / 81 (49.4%):  62%|██████▏   | 80/130 [00:10<00:06,  7.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 82 (48.8%):  62%|██████▏   | 81/130 [00:11<00:06,  7.94it/s]
Average Metric: 40.00 / 82 (48.8%):  63%|██████▎   | 82/130 [00:11<00:06,  7.10it/s]
Average Metric: 40.00 / 83 (48.2%):  63%|██████▎   | 82/130 [00:11<00:06,  7.10it/s]
Average Metric: 40.00 / 84 (47.6%):  64%|██████▍   | 83/130 [00:11<00:06,  7.10it/s]
Average Metric: 41.00 / 85 (48.2%):  65%|██████▍   | 84/130 [00:11<00:06,  7.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 86 (48.8%):  65%|██████▌   | 85/130 [00:11<00:06,  7.10it/s]
Average Metric: 43.00 / 87 (49.4%):  66%|██████▌   | 86/130 [00:11<00:06,  7.10it/s]
Average Metric: 43.00 / 88 (48.9%):  67%|██████▋   | 87/130 [00:11<00:06,  7.10it/s]
Average Metric: 44.00 / 89 (49.4%):  68%|██████▊   | 88/130 [00:11<00:05,  7.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 45.00 / 90 (50.0%):  68%|██████▊   | 89/130 [00:11<00:05,  7.10it/s]
Average Metric: 45.00 / 90 (50.0%):  69%|██████▉   | 90/130 [00:11<00:04,  8.92it/s]
Average Metric: 46.00 / 91 (50.5%):  69%|██████▉   | 90/130 [00:12<00:04,  8.92it/s]
Average Metric: 47.00 / 92 (51.1%):  70%|███████   | 91/130 [00:12<00:04,  8.92it/s]
Average Metric: 47.00 / 92 (51.1%):  71%|███████   | 92/130 [00:12<00:04,  9.09it/s]
Average Metric: 48.00 / 93 (51.6%):  71%|███████   | 92/130 [00:12<00:04,  9.09it/s]
Average Metric: 49.00 / 94 (52.1%):  72%|███████▏  | 93/130 [00:12<00:04,  9.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 95 (52.6%):  72%|███████▏  | 94/130 [00:12<00:03,  9.09it/s]
Average Metric: 50.00 / 96 (52.1%):  73%|███████▎  | 95/130 [00:12<00:03,  9.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 97 (51.5%):  74%|███████▍  | 96/130 [00:12<00:03,  9.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 98 (51.0%):  75%|███████▍  | 97/130 [00:12<00:03,  9.09it/s]
Average Metric: 50.00 / 98 (51.0%):  75%|███████▌  | 98/130 [00:12<00:03,  8.21it/s]
Average Metric: 51.00 / 99 (51.5%):  75%|███████▌  | 98/130 [00:12<00:03,  8.21it/s]
Average Metric: 52.00 / 100 (52.0%):  76%|███████▌  | 99/130 [00:12<00:03,  8.21it/s]
Average Metric: 53.00 / 101 (52.5%):  77%|███████▋  | 100/130 [00:12<00:03,  8.21it/s]
Average Metric: 54.00 / 102 (52.9%):  78%|███████▊  | 101/130 [00:12<00:03,  8.21it/s]
Average Metric: 54.00 / 103 (52.4%):  78%|███████▊  | 102/130 [00:12<00:03,  8.21it/s]
Average Metric: 55.00 / 104 (52.9%):  79%|███████▉  | 103/130 [00:12<00:03,  8.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 105 (53.3%):  80%|████████  | 104/130 [00:13<00:03,  8.21it/s]
Average Metric: 56.00 / 105 (53.3%):  81%|████████  | 105/130 [00:13<00:03,  7.85it/s]
Average Metric: 57.00 / 106 (53.8%):  81%|████████  | 105/130 [00:13<00:03,  7.85it/s]
Average Metric: 58.00 / 107 (54.2%):  82%|████████▏ | 106/130 [00:13<00:03,  7.85it/s]
Average Metric: 59.00 / 108 (54.6%):  82%|████████▏ | 107/130 [00:13<00:02,  7.85it/s]
Average Metric: 60.00 / 109 (55.0%):  83%|████████▎ | 108/130 [00:13<00:02,  7.85it/s]
Average Metric: 60.00 / 110 (54.5%):  84%|████████▍ | 109/130 [00:13<00:02,  7.85it/s]
Average Metric: 61.00 / 111 (55.0%):  85%|████████▍ | 110/130 [00:13<00:02,  7.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 61.00 / 112 (54.5%):  85%|████████▌ | 111/130 [00:14<00:02,  7.85it/s]
Average Metric: 61.00 / 112 (54.5%):  86%|████████▌ | 112/130 [00:14<00:01,  9.10it/s]
Average Metric: 62.00 / 113 (54.9%):  86%|████████▌ | 112/130 [00:14<00:01,  9.10it/s]
Average Metric: 62.00 / 114 (54.4%):  87%|████████▋ | 113/130 [00:14<00:01,  9.10it/s]
Average Metric: 63.00 / 115 (54.8%):  88%|████████▊ | 114/130 [00:14<00:01,  9.10it/s]
Average Metric: 64.00 / 116 (55.2%):  88%|████████▊ | 115/130 [00:14<00:01,  9.10it/s]
Average Metric: 65.00 / 117 (55.6%):  89%|████████▉ | 116/130 [00:14<00:01,  9.10it/s]
Average Metric: 65.00 / 118 (55.1%):  90%|█████████ | 117/130 [00:14<00:01,  9.10it/s]
Average Metric: 65.00 / 118 (55.1%):  91%|█████████ | 118/130 [00:14<00:01, 11.11it/s]
Average Metric: 65.00 / 119 (54.6%):  91%|█████████ | 118/130 [00:14<00:01, 11.11it/s]
Average Metric: 66.00 / 120 (55.0%):  92%|█████████▏| 119/130 [00:14<00:00, 11.11it/s]
Average Metric: 66.00 / 120 (55.0%):  92%|█████████▏| 120/130 [00:14<00:01,  9.90it/s]
Average Metric: 67.00 / 121 (55.4%):  92%|█████████▏| 120/130 [00:15<00:01,  9.90it/s]
Average Metric: 68.00 / 122 (55.7%):  93%|█████████▎| 121/130 [00:15<00:00,  9.90it/s]
Average Metric: 68.00 / 122 (55.7%):  94%|█████████▍| 122/130 [00:15<00:00,  9.81it/s]
Average Metric: 69.00 / 123 (56.1%):  94%|█████████▍| 122/130 [00:15<00:00,  9.81it/s]
Average Metric: 69.00 / 124 (55.6%):  95%|█████████▍| 123/130 [00:15<00:00,  9.81it/s]
Average Metric: 69.00 / 124 (55.6%):  95%|█████████▌| 124/130 [00:15<00:00, 10.26it/s]
Average Metric: 70.00 / 125 (56.0%):  95%|█████████▌| 124/130 [00:15<00:00, 10.26it/s]
Average Metric: 70.00 / 126 (55.6%):  96%|█████████▌| 125/130 [00:15<00:00, 10.26it/s]
Average Metric: 70.00 / 126 (55.6%):  97%|█████████▋| 126/130 [00:15<00:00, 10.81it/s]
Average Metric: 71.00 / 127 (55.9%):  97%|█████████▋| 126/130 [00:15<00:00, 10.81it/s]
Average Metric: 72.00 / 128 (56.2%):  98%|█████████▊| 127/130 [00:15<00:00, 10.81it/s]
Average Metric: 72.00 / 128 (56.2%):  98%|█████████▊| 128/130 [00:15<00:00, 10.42it/s]
Average Metric: 72.00 / 129 (55.8%):  98%|█████████▊| 128/130 [00:15<00:00, 10.42it/s]
Average Metric: 73.00 / 130 (56.2%):  99%|█████████▉| 129/130 [00:17<00:00, 10.42it/s]
Average Metric: 73.00 / 130 (56.2%): 100%|██████████| 130/130 [00:17<00:00,  4.18it/s]
Average Metric: 73.00 / 130 (56.2%): 100%|██████████| 130/130 [00:17<00:00,  7.61it/s]
2025/04/28 17:16:14 INFO dspy.evaluate.evaluate: Average Metric: 73 / 130 (56.2%)

  0%|          | 0/131 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/131 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/131 [00:01<03:46,  1.74s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/131 [00:01<03:46,  1.74s/it]
Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/131 [00:01<03:44,  1.74s/it]
Average Metric: 4.00 / 4 (100.0%):   2%|▏         | 3/131 [00:01<03:42,  1.74s/it]
Average Metric: 5.00 / 5 (100.0%):   3%|▎         | 4/131 [00:01<03:40,  1.74s/it]
Average Metric: 5.00 / 6 (83.3%):   4%|▍         | 5/131 [00:01<03:39,  1.74s/it] 
Average Metric: 6.00 / 7 (85.7%):   5%|▍         | 6/131 [00:01<03:37,  1.74s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):   5%|▌         | 7/131 [00:01<03:35,  1.74s/it]
Average Metric: 7.00 / 8 (87.5%):   6%|▌         | 8/131 [00:01<00:21,  5.61it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):   6%|▌         | 8/131 [00:02<00:21,  5.61it/s]
Average Metric: 7.00 / 10 (70.0%):   7%|▋         | 9/131 [00:02<00:21,  5.61it/s]
Average Metric: 7.00 / 11 (63.6%):   8%|▊         | 10/131 [00:02<00:21,  5.61it/s]
Average Metric: 7.00 / 11 (63.6%):   8%|▊         | 11/131 [00:02<00:18,  6.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 12 (66.7%):   8%|▊         | 11/131 [00:02<00:18,  6.53it/s]
Average Metric: 8.00 / 13 (61.5%):   9%|▉         | 12/131 [00:02<00:18,  6.53it/s]
Average Metric: 8.00 / 13 (61.5%):  10%|▉         | 13/131 [00:02<00:21,  5.58it/s]
Average Metric: 9.00 / 14 (64.3%):  10%|▉         | 13/131 [00:02<00:21,  5.58it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 15 (60.0%):  11%|█         | 14/131 [00:03<00:20,  5.58it/s]
Average Metric: 9.00 / 15 (60.0%):  11%|█▏        | 15/131 [00:03<00:24,  4.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 16 (56.2%):  11%|█▏        | 15/131 [00:03<00:24,  4.78it/s]
Average Metric: 9.00 / 16 (56.2%):  12%|█▏        | 16/131 [00:03<00:22,  5.12it/s]
Average Metric: 9.00 / 17 (52.9%):  12%|█▏        | 16/131 [00:03<00:22,  5.12it/s]
Average Metric: 10.00 / 18 (55.6%):  13%|█▎        | 17/131 [00:03<00:22,  5.12it/s]
Average Metric: 10.00 / 19 (52.6%):  14%|█▎        | 18/131 [00:03<00:22,  5.12it/s]
Average Metric: 11.00 / 20 (55.0%):  15%|█▍        | 19/131 [00:03<00:21,  5.12it/s]
Average Metric: 12.00 / 21 (57.1%):  15%|█▌        | 20/131 [00:03<00:21,  5.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 22 (59.1%):  16%|█▌        | 21/131 [00:03<00:21,  5.12it/s]
Average Metric: 13.00 / 22 (59.1%):  17%|█▋        | 22/131 [00:03<00:11,  9.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 23 (56.5%):  17%|█▋        | 22/131 [00:03<00:11,  9.54it/s]
Average Metric: 14.00 / 24 (58.3%):  18%|█▊        | 23/131 [00:03<00:11,  9.54it/s]
Average Metric: 14.00 / 24 (58.3%):  18%|█▊        | 24/131 [00:03<00:12,  8.63it/s]
Average Metric: 15.00 / 25 (60.0%):  18%|█▊        | 24/131 [00:03<00:12,  8.63it/s]
Average Metric: 16.00 / 26 (61.5%):  19%|█▉        | 25/131 [00:04<00:12,  8.63it/s]
Average Metric: 16.00 / 26 (61.5%):  20%|█▉        | 26/131 [00:04<00:13,  7.91it/s]
Average Metric: 16.00 / 27 (59.3%):  20%|█▉        | 26/131 [00:04<00:13,  7.91it/s]
Average Metric: 17.00 / 28 (60.7%):  21%|██        | 27/131 [00:04<00:13,  7.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 29 (62.1%):  21%|██▏       | 28/131 [00:04<00:13,  7.91it/s]
Average Metric: 18.00 / 29 (62.1%):  22%|██▏       | 29/131 [00:04<00:14,  7.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 30 (63.3%):  22%|██▏       | 29/131 [00:05<00:14,  7.01it/s]
Average Metric: 19.00 / 30 (63.3%):  23%|██▎       | 30/131 [00:05<00:16,  6.31it/s]
Average Metric: 20.00 / 31 (64.5%):  23%|██▎       | 30/131 [00:05<00:16,  6.31it/s]
Average Metric: 21.00 / 32 (65.6%):  24%|██▎       | 31/131 [00:05<00:15,  6.31it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 33 (66.7%):  24%|██▍       | 32/131 [00:05<00:15,  6.31it/s]
Average Metric: 23.00 / 34 (67.6%):  25%|██▌       | 33/131 [00:05<00:15,  6.31it/s]
Average Metric: 24.00 / 35 (68.6%):  26%|██▌       | 34/131 [00:05<00:15,  6.31it/s]
Average Metric: 24.00 / 36 (66.7%):  27%|██▋       | 35/131 [00:05<00:15,  6.31it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 37 (67.6%):  27%|██▋       | 36/131 [00:05<00:15,  6.31it/s]
Average Metric: 25.00 / 37 (67.6%):  28%|██▊       | 37/131 [00:05<00:10,  9.18it/s]
Average Metric: 26.00 / 38 (68.4%):  28%|██▊       | 37/131 [00:05<00:10,  9.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 39 (66.7%):  29%|██▉       | 38/131 [00:05<00:10,  9.18it/s]
Average Metric: 26.00 / 40 (65.0%):  30%|██▉       | 39/131 [00:05<00:10,  9.18it/s]
Average Metric: 26.00 / 41 (63.4%):  31%|███       | 40/131 [00:05<00:09,  9.18it/s]
Average Metric: 27.00 / 42 (64.3%):  31%|███▏      | 41/131 [00:05<00:09,  9.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 43 (62.8%):  32%|███▏      | 42/131 [00:06<00:09,  9.18it/s]
Average Metric: 27.00 / 43 (62.8%):  33%|███▎      | 43/131 [00:06<00:09,  9.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 28.00 / 44 (63.6%):  33%|███▎      | 43/131 [00:06<00:09,  9.16it/s]
Average Metric: 28.00 / 44 (63.6%):  34%|███▎      | 44/131 [00:06<00:11,  7.50it/s]
Average Metric: 29.00 / 45 (64.4%):  34%|███▎      | 44/131 [00:06<00:11,  7.50it/s]
Average Metric: 29.00 / 46 (63.0%):  34%|███▍      | 45/131 [00:06<00:11,  7.50it/s]
Average Metric: 29.00 / 46 (63.0%):  35%|███▌      | 46/131 [00:06<00:10,  8.17it/s]
Average Metric: 30.00 / 47 (63.8%):  35%|███▌      | 46/131 [00:06<00:10,  8.17it/s]
Average Metric: 30.00 / 48 (62.5%):  36%|███▌      | 47/131 [00:06<00:10,  8.17it/s]
Average Metric: 30.00 / 49 (61.2%):  37%|███▋      | 48/131 [00:06<00:10,  8.17it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 50 (62.0%):  37%|███▋      | 49/131 [00:06<00:10,  8.17it/s]
Average Metric: 32.00 / 51 (62.7%):  38%|███▊      | 50/131 [00:07<00:09,  8.17it/s]
Average Metric: 32.00 / 51 (62.7%):  39%|███▉      | 51/131 [00:07<00:11,  6.92it/s]
Average Metric: 32.00 / 52 (61.5%):  39%|███▉      | 51/131 [00:07<00:11,  6.92it/s]
Average Metric: 32.00 / 53 (60.4%):  40%|███▉      | 52/131 [00:07<00:11,  6.92it/s]
Average Metric: 33.00 / 54 (61.1%):  40%|████      | 53/131 [00:07<00:11,  6.92it/s]
Average Metric: 33.00 / 55 (60.0%):  41%|████      | 54/131 [00:07<00:11,  6.92it/s]
Average Metric: 34.00 / 56 (60.7%):  42%|████▏     | 55/131 [00:07<00:10,  6.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 57 (59.6%):  43%|████▎     | 56/131 [00:07<00:10,  6.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 58 (60.3%):  44%|████▎     | 57/131 [00:08<00:10,  6.92it/s]
Average Metric: 35.00 / 58 (60.3%):  44%|████▍     | 58/131 [00:08<00:09,  7.32it/s]
Average Metric: 35.00 / 59 (59.3%):  44%|████▍     | 58/131 [00:08<00:09,  7.32it/s]
Average Metric: 36.00 / 60 (60.0%):  45%|████▌     | 59/131 [00:08<00:09,  7.32it/s]
Average Metric: 37.00 / 61 (60.7%):  46%|████▌     | 60/131 [00:08<00:09,  7.32it/s]
Average Metric: 38.00 / 62 (61.3%):  47%|████▋     | 61/131 [00:08<00:09,  7.32it/s]
Average Metric: 38.00 / 63 (60.3%):  47%|████▋     | 62/131 [00:08<00:09,  7.32it/s]
Average Metric: 38.00 / 64 (59.4%):  48%|████▊     | 63/131 [00:08<00:09,  7.32it/s]
Average Metric: 39.00 / 65 (60.0%):  49%|████▉     | 64/131 [00:08<00:09,  7.32it/s]
Average Metric: 40.00 / 66 (60.6%):  50%|████▉     | 65/131 [00:08<00:09,  7.32it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 67 (59.7%):  50%|█████     | 66/131 [00:08<00:08,  7.32it/s]
Average Metric: 41.00 / 68 (60.3%):  51%|█████     | 67/131 [00:08<00:08,  7.32it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 69 (59.4%):  52%|█████▏    | 68/131 [00:09<00:08,  7.32it/s]
Average Metric: 41.00 / 69 (59.4%):  53%|█████▎    | 69/131 [00:09<00:07,  8.09it/s]
Average Metric: 42.00 / 70 (60.0%):  53%|█████▎    | 69/131 [00:09<00:07,  8.09it/s]
Average Metric: 43.00 / 71 (60.6%):  53%|█████▎    | 70/131 [00:09<00:07,  8.09it/s]
Average Metric: 44.00 / 72 (61.1%):  54%|█████▍    | 71/131 [00:09<00:07,  8.09it/s]
Average Metric: 44.00 / 73 (60.3%):  55%|█████▍    | 72/131 [00:09<00:07,  8.09it/s]
Average Metric: 44.00 / 74 (59.5%):  56%|█████▌    | 73/131 [00:09<00:07,  8.09it/s]
Average Metric: 44.00 / 75 (58.7%):  56%|█████▋    | 74/131 [00:09<00:07,  8.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 76 (57.9%):  57%|█████▋    | 75/131 [00:10<00:06,  8.09it/s]
Average Metric: 44.00 / 76 (57.9%):  58%|█████▊    | 76/131 [00:10<00:07,  7.84it/s]
Average Metric: 45.00 / 77 (58.4%):  58%|█████▊    | 76/131 [00:10<00:07,  7.84it/s]
Average Metric: 45.00 / 78 (57.7%):  59%|█████▉    | 77/131 [00:10<00:06,  7.84it/s]
Average Metric: 45.00 / 79 (57.0%):  60%|█████▉    | 78/131 [00:10<00:06,  7.84it/s]
Average Metric: 46.00 / 80 (57.5%):  60%|██████    | 79/131 [00:10<00:06,  7.84it/s]
Average Metric: 47.00 / 81 (58.0%):  61%|██████    | 80/131 [00:10<00:06,  7.84it/s]
Average Metric: 47.00 / 82 (57.3%):  62%|██████▏   | 81/131 [00:10<00:06,  7.84it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 83 (57.8%):  63%|██████▎   | 82/131 [00:11<00:06,  7.84it/s]
Average Metric: 48.00 / 83 (57.8%):  63%|██████▎   | 83/131 [00:11<00:05,  8.37it/s]
Average Metric: 48.00 / 84 (57.1%):  63%|██████▎   | 83/131 [00:11<00:05,  8.37it/s]
Average Metric: 49.00 / 85 (57.6%):  64%|██████▍   | 84/131 [00:11<00:05,  8.37it/s]
Average Metric: 50.00 / 86 (58.1%):  65%|██████▍   | 85/131 [00:11<00:05,  8.37it/s]
Average Metric: 51.00 / 87 (58.6%):  66%|██████▌   | 86/131 [00:11<00:05,  8.37it/s]
Average Metric: 52.00 / 88 (59.1%):  66%|██████▋   | 87/131 [00:11<00:05,  8.37it/s]
Average Metric: 53.00 / 89 (59.6%):  67%|██████▋   | 88/131 [00:11<00:05,  8.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 90 (58.9%):  68%|██████▊   | 89/131 [00:11<00:05,  8.37it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 91 (59.3%):  69%|██████▊   | 90/131 [00:12<00:04,  8.37it/s]
Average Metric: 54.00 / 91 (59.3%):  69%|██████▉   | 91/131 [00:12<00:04,  8.02it/s]
Average Metric: 54.00 / 92 (58.7%):  69%|██████▉   | 91/131 [00:12<00:04,  8.02it/s]
Average Metric: 55.00 / 93 (59.1%):  70%|███████   | 92/131 [00:12<00:04,  8.02it/s]
Average Metric: 55.00 / 94 (58.5%):  71%|███████   | 93/131 [00:12<00:04,  8.02it/s]
Average Metric: 56.00 / 95 (58.9%):  72%|███████▏  | 94/131 [00:12<00:04,  8.02it/s]
Average Metric: 56.00 / 96 (58.3%):  73%|███████▎  | 95/131 [00:12<00:04,  8.02it/s]
Average Metric: 57.00 / 97 (58.8%):  73%|███████▎  | 96/131 [00:12<00:04,  8.02it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 57.00 / 98 (58.2%):  74%|███████▍  | 97/131 [00:13<00:04,  8.02it/s]
Average Metric: 57.00 / 98 (58.2%):  75%|███████▍  | 98/131 [00:13<00:03,  9.08it/s]
Average Metric: 58.00 / 99 (58.6%):  75%|███████▍  | 98/131 [00:13<00:03,  9.08it/s]
Average Metric: 59.00 / 100 (59.0%):  76%|███████▌  | 99/131 [00:13<00:03,  9.08it/s]
Average Metric: 60.00 / 101 (59.4%):  76%|███████▋  | 100/131 [00:13<00:03,  9.08it/s]
Average Metric: 61.00 / 102 (59.8%):  77%|███████▋  | 101/131 [00:13<00:03,  9.08it/s]
Average Metric: 62.00 / 103 (60.2%):  78%|███████▊  | 102/131 [00:13<00:03,  9.08it/s]
Average Metric: 63.00 / 104 (60.6%):  79%|███████▊  | 103/131 [00:13<00:03,  9.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 64.00 / 105 (61.0%):  79%|███████▉  | 104/131 [00:13<00:02,  9.08it/s]
Average Metric: 64.00 / 105 (61.0%):  80%|████████  | 105/131 [00:13<00:03,  8.60it/s]
Average Metric: 65.00 / 106 (61.3%):  80%|████████  | 105/131 [00:13<00:03,  8.60it/s]
Average Metric: 65.00 / 107 (60.7%):  81%|████████  | 106/131 [00:13<00:02,  8.60it/s]
Average Metric: 65.00 / 108 (60.2%):  82%|████████▏ | 107/131 [00:13<00:02,  8.60it/s]
Average Metric: 66.00 / 109 (60.6%):  82%|████████▏ | 108/131 [00:13<00:02,  8.60it/s]
Average Metric: 67.00 / 110 (60.9%):  83%|████████▎ | 109/131 [00:13<00:02,  8.60it/s]
Average Metric: 67.00 / 111 (60.4%):  84%|████████▍ | 110/131 [00:13<00:02,  8.60it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 67.00 / 112 (59.8%):  85%|████████▍ | 111/131 [00:14<00:02,  8.60it/s]
Average Metric: 67.00 / 112 (59.8%):  85%|████████▌ | 112/131 [00:14<00:02,  9.36it/s]
Average Metric: 67.00 / 113 (59.3%):  85%|████████▌ | 112/131 [00:14<00:02,  9.36it/s]
Average Metric: 67.00 / 114 (58.8%):  86%|████████▋ | 113/131 [00:14<00:01,  9.36it/s]
Average Metric: 68.00 / 115 (59.1%):  87%|████████▋ | 114/131 [00:14<00:01,  9.36it/s]
Average Metric: 68.00 / 116 (58.6%):  88%|████████▊ | 115/131 [00:14<00:01,  9.36it/s]
Average Metric: 68.00 / 117 (58.1%):  89%|████████▊ | 116/131 [00:14<00:01,  9.36it/s]
Average Metric: 69.00 / 118 (58.5%):  89%|████████▉ | 117/131 [00:14<00:01,  9.36it/s]
Average Metric: 70.00 / 119 (58.8%):  90%|█████████ | 118/131 [00:15<00:01,  9.36it/s]
Average Metric: 70.00 / 119 (58.8%):  91%|█████████ | 119/131 [00:15<00:01, 10.28it/s]
Average Metric: 70.00 / 120 (58.3%):  91%|█████████ | 119/131 [00:15<00:01, 10.28it/s]
Average Metric: 71.00 / 121 (58.7%):  92%|█████████▏| 120/131 [00:15<00:01, 10.28it/s]
Average Metric: 71.00 / 121 (58.7%):  92%|█████████▏| 121/131 [00:15<00:00, 10.54it/s]
Average Metric: 72.00 / 122 (59.0%):  92%|█████████▏| 121/131 [00:15<00:00, 10.54it/s]
Average Metric: 73.00 / 123 (59.3%):  93%|█████████▎| 122/131 [00:15<00:00, 10.54it/s]
Average Metric: 73.00 / 123 (59.3%):  94%|█████████▍| 123/131 [00:15<00:00, 11.19it/s]
Average Metric: 73.00 / 124 (58.9%):  94%|█████████▍| 123/131 [00:15<00:00, 11.19it/s]
Average Metric: 74.00 / 125 (59.2%):  95%|█████████▍| 124/131 [00:15<00:00, 11.19it/s]
Average Metric: 74.00 / 125 (59.2%):  95%|█████████▌| 125/131 [00:15<00:00, 10.95it/s]
Average Metric: 75.00 / 126 (59.5%):  95%|█████████▌| 125/131 [00:15<00:00, 10.95it/s]
Average Metric: 75.00 / 127 (59.1%):  96%|█████████▌| 126/131 [00:15<00:00, 10.95it/s]
Average Metric: 75.00 / 127 (59.1%):  97%|█████████▋| 127/131 [00:15<00:00, 11.10it/s]
Average Metric: 76.00 / 128 (59.4%):  97%|█████████▋| 127/131 [00:15<00:00, 11.10it/s]
Average Metric: 76.00 / 129 (58.9%):  98%|█████████▊| 128/131 [00:16<00:00, 11.10it/s]
Average Metric: 76.00 / 129 (58.9%):  98%|█████████▊| 129/131 [00:16<00:00,  9.14it/s]
Average Metric: 77.00 / 130 (59.2%):  98%|█████████▊| 129/131 [00:16<00:00,  9.14it/s]2025/04/28 17:16:31 INFO dspy.evaluate.evaluate: Average Metric: 78 / 131 (59.5%)

Average Metric: 78.00 / 131 (59.5%):  99%|█████████▉| 130/131 [00:16<00:00,  9.14it/s]
Average Metric: 78.00 / 131 (59.5%): 100%|██████████| 131/131 [00:16<00:00,  9.69it/s]
Average Metric: 78.00 / 131 (59.5%): 100%|██████████| 131/131 [00:16<00:00,  8.07it/s]
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
