DEV Community

Cover image for Deepseek R1 vs OpenAI o1

Deepseek R1 vs OpenAI o1

Maxim Saplin on January 23, 2025

Deepseek R1 is out - available via Deepseek API or free Deepseek chat. If you are following LLM/Gen AI space you've likely seen titles, read posts,...
Collapse
 
markaurit profile image
MarkAurit

I performed a moderately complex, real-life query against the usa stock market using ChatGPT and DeepSeek. I only had one measurement of success: an accurate return of information. ChatGPT did extremely well - it added a chart (not requested) and much more information than just the closing price; in other words, about what you get on Yahoo Finance stock queries. DeepSeek merely replied with "that information isnt in my system yet". I realize that DeepSeek is a tool in its relative infancy, and in time it will be just as powerful and useful as ChatGPT. But as of now, it is useless to me.
Query: what is the stock market price of AAPL

Collapse
 
sweet_knives_92756f790208 profile image
Sweet Knives

I used that same query in deepseek and this is the answer I get:

As of the latest available data in the search results (dated January 28, 2025), the closing stock price of Apple Inc. (AAPL) was $238.26, reflecting a +3.65% increase from the previous trading session . During extended trading hours on January 28, the price slightly fluctuated to $238.34 (+0.04%) . Pre-market data for January 29, 2025, shows a slight decline to $237.34 (-0.39%) as of 4:29 AM EST .

Key Details:

  1. Recent Performance:

    • The stock reached a daily high of $240.19 and a low of $230.81 on January 28, 2025 .
    • Over the past month, Apple’s stock has faced volatility, with a 1-month decline of -6.78% but a 1-year gain of +23.82% .
  2. Market Context:

    • Apple’s market capitalization stands at $3.58 trillion, maintaining its position as one of the largest publicly traded companies .
    • Analysts have expressed mixed sentiments, with concerns about iPhone demand in China and slower-than-expected adoption of its AI features ("Apple Intelligence") .
  3. Upcoming Catalyst:

    • The company is set to release its December 2024 quarter earnings on January 30, 2025, which could significantly impact the stock price depending on iPhone sales and AI-related updates .

For real-time updates, refer to financial platforms like Yahoo Finance or Google Finance.

sounds stupid but... are you sure you activate web search?

Collapse
 
rana_masoud_3841f726be272 profile image
Rana Masoud

What I've experienced is that if you ask something Political regarding China especially, you'll observe that it gives an a Biased Answer.

Whereas for CHAT GPT, even if you ask the same for America, observe neutral replies.

I think it won't last long if it stays Biased towards a country or developer.

Collapse
 
host510 profile image
Mikhail

As a user I am annoyed. The Deepseek server is always busy.

Collapse
 
reeizer profile image
Reeizer

^^^^ THIS

Better performance /= stability

I have the same problem with "always busy"

Collapse
 
ghostdev26 profile image
Ryan Pretorius

Host it locally :-) No more issues

Collapse
 
host510 profile image
Mikhail

Thanks a lot :). I am also disappointed by the quality of the answers as compared even to GPT-o4

Collapse
 
amtrakguy2 profile image
AmtrakGuy2

Glad to know that I'm not the only one lol

Collapse
 
peter_truchly_4fce0874fd5 profile image
Peter Truchly

My first thought was: why would anyone even try to play chess with LLM? There are better "algorithms" for that.
But yes, especially in todays world where everybody is expecting AGI with every new LLM why it shouldn't play chess after all?

Where I see the problem (and a limitation) of current approach is the misuse of general purpose reasoning capabilities of LLMs, which are undeniably there but only in emergent form. What would average person do if confronted with this task? Most of us would just use some software, smaller portion would implement their own software and only handful (of chess masters) would play by themselves.

Unless we equip these 'AI' models with complete set of tools, environment and ability to use workflow patterns to model and execute a workflow designed for a given task, results are going to be quite disappointing, at least for the nearby future.

Collapse
 
amtrakguy2 profile image
AmtrakGuy2

For me currently, DeepSeek has been extremely unhelpful and annoying. The servers are always busy. I understand that DeepSeek is still in its early stages, but the developers should have tested their product before publishing it. In my personal opinion, ChatGPT is actually the best tool to use professionally, and it has become my favorite. I do hope that DeepSeek continues to advance though. Maybe some day, DeepSeek will be just as powerful, if not more powerful, than ChatGPT. Cheers to a promising future!

Collapse
 
maximsaplin profile image
Maxim Saplin

If the only complain is Deepseek's web app availability (not the quality of responses) - it's hard to blame the folks for not burning millions to serve the avalanche of user requests, for free. Don't you think so?)

Collapse
 
amtrakguy2 profile image
AmtrakGuy2
Comment hidden by post author
 
maximsaplin profile image
Maxim Saplin • Edited

Can you share more detail about SQL injections that you tried with DeepSeek (presumably chat.deepseek.com)? What, when, how..

Thread Thread
 
wuya666 profile image
wuya666

It seems DeepSeek has many great talents in AI development/optimization, but doesn't care much about good web developers. The way how it pops up lots of Cloudflare CAPTCHA boxes all across the website at times shows they are not even trying to make good quality web frontend and backend...

Thread Thread
 
amtrakguy2 profile image
AmtrakGuy2 • Edited

I tried the SQL Injections on January 31, 2025. I just used SQLite to automatically connect to one of DeepSeek's servers, and it actually worked. And yes, it was chat.deepseek.com

Collapse
 
wuya666 profile image
wuya666

i think the DeepSeek folks are just lacking good web developers, unlike all the brilliant AI developers they have. They really need to recruit some better web developers, the way how dozens of Cloudflare CAPTCHA boxes can pop up in a single page just shows bad web developers at work

Thread Thread
 
amtrakguy2 profile image
AmtrakGuy2

That is the least of their worries. Really, they need to actually hire some trustworthy folks that can actually provide good security for all of the sites. In my opinion, they should focus on security first, then they can start fixing the product itself.

Collapse
 
ai_joddd profile image
Vinayak Mishra

Nice post.. Had a question for you after seeing this. How good is deepseek than others w.r.t hallucinations, as yesterday night I was reading a content piece on LLM hallucination detection..

Collapse
 
maximsaplin profile image
Maxim Saplin

Assuming that a hallucinations include cases when the model does not what it is asked for (e.g. skips an acton) or decides to make move that is not legal - R1 is quite bad. You can tell this by large number of mistakes and low average game duration (you can see that by hovering over a row in the leaderboard)

Collapse
 
kurealnum profile image
Oscar

To be honest, I'm just happy there's a contender for "best AI model" that isn't made by a multi billion dollar tech corporation from the US (well, Deepseek's company might be worth billions now lol). All that being said, for the few times that I actually utilize AI in my own work, I still use ChatGPT.

Collapse
 
juana_daniel_096 profile image
Juana Daniel

This is such an interesting topic! I'm really happy to hear about it. I absolutely Love it, and you should definitely check out more topics like this.

Some comments have been hidden by the post's author - find out more