Jan 15, 2024

GPT-4 only gets it right 16.7% of the time

GPT-4 only gets it right 16.7% of the time

GPT-4 only gets it right 16.7% of the time

GPT-4 only gets it right 16.7% of the time when extracting insights from company databases (using SQL).

  1. Does ChatGPT and LLMs have no idea about what they are talking about?

  2. GPT-4 failed to provide any correct answers for all questions that required it to gather data from more than five tables.

  3. If the model is provided with a semantic layer representing the relationships in the data, accuracy increases by, on average, 300%.

In short, Large Language Models (LLMs) will be a crucial tool for enabling a step-change in how we work, but will need a bit of help. At Aevy, we ensure that management of renewable assets will benefit from the AI revolution by providing scalable and reliable high-quality outcomes.

So, how close to the “peak of inflated expectations” on the Gartner “hype cycle” are we? Will we dip down into the “trough of disillusionment”, or is it possible to build a bridge directly to the “plateau of productivity”? We sure believe it is!

Check out the LinkedIn post here.

(Source: https://lnkd.in/emBexNiA)

GPT-4 only gets it right 16.7% of the time when extracting insights from company databases (using SQL).

  1. Does ChatGPT and LLMs have no idea about what they are talking about?

  2. GPT-4 failed to provide any correct answers for all questions that required it to gather data from more than five tables.

  3. If the model is provided with a semantic layer representing the relationships in the data, accuracy increases by, on average, 300%.

In short, Large Language Models (LLMs) will be a crucial tool for enabling a step-change in how we work, but will need a bit of help. At Aevy, we ensure that management of renewable assets will benefit from the AI revolution by providing scalable and reliable high-quality outcomes.

So, how close to the “peak of inflated expectations” on the Gartner “hype cycle” are we? Will we dip down into the “trough of disillusionment”, or is it possible to build a bridge directly to the “plateau of productivity”? We sure believe it is!

Check out the LinkedIn post here.

(Source: https://lnkd.in/emBexNiA)

FAQ

Have a question not answered to the right, or just want to chat? Reach out!

How does Aevy work?

+

Why do I need Aevy?

+

Why can I not do this with my existing software?

+

Isn't this what Microsoft co-pilot will do for me?

+

Which types of assets can Aevy be used for?

+

Is it difficult and time-consuming to onboard my portfolio?

+

Which languages are supported?

+

Aevy is a Norwegian tech company focused on making the management of renewable energy assets scalable through automated information management, insights generation, and task completion. Our platform automates ingestion and structuring of information from unstructured sources, typically documents containing large amounts of text.

By using our services you accept our privacy policy.

Aevy AS
Gaustadalléen 21
0349 Oslo
NORWAY

Made with precision and enthusiasm in

FAQ

Have a question not answered to the right, or just want to chat? Reach out!

How does Aevy work?

+

Why do I need Aevy?

+

Why can I not do this with my existing software?

+

Isn't this what Microsoft co-pilot will do for me?

+

Which types of assets can Aevy be used for?

+

Is it difficult and time-consuming to onboard my portfolio?

+

Which languages are supported?

+

Aevy is a Norwegian tech company focused on making the management of renewable energy assets scalable through automated information management, insights generation, and task completion. Our platform automates ingestion and structuring of information from unstructured sources, typically documents containing large amounts of text.

By using our services you accept our privacy policy.

Aevy AS
Gaustadalléen 21
0349 Oslo
NORWAY

Made with precision and enthusiasm in

FAQ

Have a question not answered to the right, or just want to chat? Reach out!

How does Aevy work?

+

Why do I need Aevy?

+

Why can I not do this with my existing software?

+

Isn't this what Microsoft co-pilot will do for me?

+

Which types of assets can Aevy be used for?

+

Is it difficult and time-consuming to onboard my portfolio?

+

Which languages are supported?

+

Aevy is a Norwegian tech company focused on making the management of renewable energy assets scalable through automated information management, insights generation, and task completion. Our platform automates ingestion and structuring of information from unstructured sources, typically documents containing large amounts of text.

By using our services you accept our privacy policy.

Aevy AS
Gaustadalléen 21
0349 Oslo
NORWAY

Made with precision and enthusiasm in