DeepVerified Results
DeepVerify provides a set of API endpoints to evaluate the factual accuracy, consistency, and reliability of information by checking against an established knowledge base and evaluating answer quality and source credibility.
Endpoints
Fact Check /fact-check
This endpoint assesses the factual accuracy and completeness of the provided information based on established knowledge.
Parameters:
input_text (required): The text or information to be fact-checked.
Evaluations:
Consistency with Established Knowledge: Checks if the information aligns with verified knowledge sources.
Fabrication: Detects if any parts of the information appear fabricated or invented.
Omission & Incomplete Information: Identifies missing elements that may lead to incomplete information.
Response Structure:
Answer Check /answer-check
This endpoint evaluates the quality and accuracy of answers or responses based on logical inferences, context, and answer detail.
Parameters:
input_text (required): The answer or response to evaluate.
Evaluations:
False Inferences: Detects incorrect logical reasoning.
Parroting or Reiteration: Identifies cases where the answer merely repeats information.
Context Consistency: Evaluates if the answer is contextually consistent.
Misinterpretation of Question: Checks if the answer misinterprets the question.
Bias Detection: Identifies potential biases in the answer.
Vague or Broad Answers: Detects if the answer is too vague or overly generalized.
Exaggeration/Distortion
Overgeneralization or Simplification: Detects oversimplification or generalizations.
Response Structure:
3. Reference Check /reference-check
This endpoint evaluates the credibility and completeness of sources or citations.
Parameters:
input_text (required): The references or citations to be evaluated.
Evaluations:
Source Reliability: Calculates the reliability score based on scores stored in cited FactBlocks.
Negation or Incomplete Information: Detects any unsupported negations or incomplete assertions.
Unverifiable Citations: Verifies if AI-cited sources are accessible and authentic. (Examples: Checks if sources are present and accessible. )
Response Structure:
Result Types
The results returned by each endpoint may include the following types:
Score: A numerical score with decimal points indicating evaluation accuracy or reliability.
Binary Value (Yes/No): A binary indicator for simple evaluations.
Text: Explanation or detailed notes based on the evaluation.
List of FactBlocks: List of FactBlocks that served as the basis for the evaluation.
List of FactBlocks with Paths: A list of FactBlocks, along with paths showing how they are connected to improve explainability.
Last updated