o Jjgj @s<ddlmZmZddlmZddlmZGdddeZdS))AnyUnion)parse_json_markdown)StringEvaluatorc seZdZdZdeddffdd ZedefddZedefd d Z ede fd d Z d ede e edeeee ffddZdedede fddZ  dde e efde e efde e efdede f ddZZS)JsonSchemaEvaluatoraAn evaluator that validates a JSON prediction against a JSON schema reference. This evaluator checks if a given JSON prediction conforms to the provided JSON schema. If the prediction is valid, the score is True (no errors). Otherwise, the score is False (error occurred). Attributes: requires_input (bool): Whether the evaluator requires input. requires_reference (bool): Whether the evaluator requires reference. evaluation_name (str): The name of the evaluation. Examples: evaluator = JsonSchemaEvaluator() result = evaluator.evaluate_strings( prediction='{"name": "John", "age": 30}', reference={ "type": "object", "properties": { "name": {"type": "string"}, "age": {"type": "integer"} } } ) assert result["score"] is not None kwargsreturnNc s0tzddl}WdStytdw)zInitializes the JsonSchemaEvaluator. Args: kwargs: Additional keyword arguments. Raises: ImportError: If the jsonschema package is not installed. rNziThe JsonSchemaEvaluator requires the jsonschema package. Please install it with `pip install jsonschema`.)super__init__ jsonschema ImportError)selfrr  __class__`/var/www/html/zoom/venv/lib/python3.10/site-packages/langchain/evaluation/parsing/json_schema.pyr #s  zJsonSchemaEvaluator.__init__cCdS)z-Returns whether the evaluator requires input.Frr rrrrequires_input5z"JsonSchemaEvaluator.requires_inputcCr)z1Returns whether the evaluator requires reference.Trrrrrrequires_reference:rz&JsonSchemaEvaluator.requires_referencecCr)z#Returns the name of the evaluation.json_schema_validationrrrrrevaluation_name?rz#JsonSchemaEvaluator.evaluation_namenodecCs:t|tr t|St|drtt|drt|dS|S)Nschema) isinstancestrrhasattrcallablegetattr)r rrrr _parse_jsonDs  zJsonSchemaEvaluator._parse_json predictionrc CsZddlm}m}z |||dddiWS|y,}z dt|dWYd}~Sd}~ww)Nr)ValidationErrorvalidate)instancerscoreTF)r% reasoning)r r"r#repr)r r!rr"r#errr _validateLs zJsonSchemaEvaluator._validateinput referencecKs ||}||}|||S)N)r r))r r!r*r+rparsed_predictionrrrr_evaluate_stringsWs   z%JsonSchemaEvaluator._evaluate_strings)NN)__name__ __module__ __qualname____doc__rr propertyboolrrrrrdictlistfloatintr r)r- __classcell__rrrrrs0$   rN)typingrrlangchain_core.utils.jsonrlangchain.evaluation.schemarrrrrrs