Running large-scale machine learning models such as ChatGPT on servers can be expensive due to the significant computational resources required to train and maintain these models. Additionally, the cost may vary depending on factors such as the size and complexity of the model, the amount of data being processed, and the level of user demand. Nonetheless, organizations that use AI language models may consider the benefits of their capabilities to be worth the costs of running them on their servers. ChatGPT is the most popular language model in the world right now, and as per recent reports, the cost of running it is quite hefty.

ChatGPT costs $700,000 a day to run, GPT-4 costs may be higher

OpenAI’s language model, ChatGPT, which provides natural language processing (NLP) services, requires significant computing power and can cost up to $700,000 to run. The high cost comes mainly from expensive servers needed to provide feedback based on user input, including writing cover letters, generating teaching plans, and optimizing personal data. Moreover, while Dylan Patel, Chief Analyst at SemiAnalysis, estimated the cost of the GPT-3 model, ChatGPT could now be even more expensive after adopting the latest GPT-4 model.

Artificial intelligence reasoning costs far exceed the cost of training, and the inference cost of ChatGPT exceeds the training cost. Companies that have been using OpenAI’s language models have been paying high prices for the past few years, and the cost of running the AI model and purchasing Amazon AWS cloud servers for the startup Latitude’s AI dungeon game cost up to $200,000 per month in 2021. Microsoft is developing an artificial intelligence chip, code-named Athena, to reduce the running cost of generative artificial intelligence models, but the chip will be released only for internal use by Microsoft and OpenAI as early as next year.

RELATED:

• ChatGPT can potentially leak confidential information and personal data, says Report
• From ChatGPT to Chemical Weapons: The Risks and Rewards of GPT-4’s Powers
• Best Apple Watch Bands 2023

(Via)

The post ChatGPT Costs $700,000 a day to Run, Reports State appeared first on Gizmochina.

Microsoft unveiled its Bing Chatbot powered by GPT-4 a while back, and needless to say, it has garnered a lot of attention worldwide. For starters, Microsoft recently announced that it has achieved a notable milestone with Bing, when its daily active users crossed 100 million. Following the release of the latest build, the company saw one-third of its daily active users being new to the search engine. Almost a week ago, the company introduced the new AI-powered Image Creator to the Bing search engine. Amidst all this, Microsoft has made sure not to include any ads on the Bing Chat page, until now. Yusuf Mehdi, Microsoft corporate vice president, recently stated that ads will soon start making their way onto Bing Chat.

The advertisements, however, won’t be too intrusive. A tweet by Debarghya Das sheds light on the company’s plan to monetize the new search engine, and it’s quite different from what you might expect. Ads will show up when a user searches for a specific product, which means the bias won’t affect users directly. What this means is that you won’t be blasted by random or targeted ads without even searching for them. Have a look at how the ad appears in this tweet:

As Debargya states in the tweet, one cannot directly compare the conversion rate through these advertisements since they are based on the user’s current searches, rather than past searches. This might be a key step towards changing the way ads work with AI-powered search engines in the future. It is worth noting that while the Bing Search Engine did have advertisements in the first place, the Bing ChatBot is a different entity for the company altogether. Mehdi’s blog post indicates that Microsoft intends to distribute ad revenue among partners whose content directly contributed to the chat response off the user’s prompt. However, it remains unclear how Microsoft plans to maintain a balance between ad and non-ad responses. One thing is for sure, the inclusion of advertisements will further complicate the task of discerning the credibility of a given response.

RELATED:

• Microsoft threatens to restrict Bing search data access to AI chatbot competitors
• Microsoft introduces AI-powered Bing Image Creator, Visual Stories
• Best Keyboard for iMac 2023

(Source, Via)

The post GPT-4 Powered Bing Chat will Get Ads Pretty Soon appeared first on Gizmochina.