I tested ChatGPT vs. Claude to see which is better - and if it's worth switching
Back to Tutorials
aiTutorialbeginner

I tested ChatGPT vs. Claude to see which is better - and if it's worth switching

April 1, 20261 views4 min read

Learn how to compare ChatGPT and Claude AI assistants by running identical tests on 10 different tasks to determine which performs better for your needs.

Introduction

In this tutorial, you'll learn how to use two popular AI chatbots - ChatGPT and Claude - to compare their performance on the same tasks. This hands-on guide will show you how to access both platforms, run identical tests, and analyze the results to help you decide which AI assistant might be better for your needs. By the end, you'll have practical experience with both platforms and a clear understanding of their differences.

Prerequisites

To follow this tutorial, you'll need:

  • A computer or mobile device with internet access
  • A web browser (Chrome, Firefox, Safari, or Edge work best)
  • Free accounts on both ChatGPT and Claude platforms
  • Basic computer literacy - you should know how to navigate websites and type in text boxes

Step-by-Step Instructions

Step 1: Create Accounts on Both Platforms

Creating a ChatGPT Account

First, visit chat.openai.com in your web browser. Click on "Sign up" and choose to create an account using your email address or Google account. You'll need to verify your email address to complete the registration.

Creating a Claude Account

Next, go to claude.ai. Click on "Sign in" and select "Create account". You can sign up using your email address or with your Google account. Complete the verification process as instructed.

Step 2: Prepare Your Test Tasks

Before you start testing, create a list of 10 simple tasks that you want both AI assistants to complete. Here are some examples to get you started:

  1. Explain what a computer virus is in simple terms
  2. Write a short poem about summer
  3. Help me plan a 3-day trip to Paris
  4. What are the benefits of eating vegetables?
  5. Write a basic Python code to add two numbers
  6. How do I fix a leaky faucet?
  7. Explain the water cycle to a 5-year-old
  8. What's the difference between a cat and a dog?
  9. Write a short story about a robot learning to paint
  10. How can I reduce my electricity bill?

Step 3: Test ChatGPT on Your First Task

Open your ChatGPT browser tab and type your first task into the chat box at the bottom of the screen. For example, type: "Explain what a computer virus is in simple terms".

Press Enter or click the send arrow button. Wait for ChatGPT's response. Take note of how well it answers, how clearly it explains, and how long the response is.

Step 4: Test Claude on the Same Task

Switch to your Claude browser tab and type the exact same task into Claude's chat box. Use the same prompt: "Explain what a computer virus is in simple terms".

Press Enter or click send. Wait for Claude's response and observe how it compares to ChatGPT's answer.

Step 5: Document Your Results

Create a simple table on paper or in a document to record your findings:

Task: Explain what a computer virus is in simple terms

ChatGPT Response: [Write what ChatGPT said]
Claude Response: [Write what Claude said]

Which was better: [Circle ChatGPT or Claude]
Why: [Brief explanation of why one was better]

Step 6: Complete All 10 Tasks

Repeat Steps 3 through 5 for all 10 tasks. For each task, make sure you use the exact same prompt on both platforms to ensure fair comparison. Don't change your wording or add extra details.

Record your observations about each response, including:

  • Clarity of explanation
  • Accuracy of information
  • Length of response
  • Helpfulness to you

Step 7: Analyze Your Findings

After completing all 10 tasks, review your notes. Look for patterns:

  • Which AI performed better on specific types of tasks?
  • Did one AI consistently outperform the other?
  • Were there tasks where both AI assistants performed similarly?

Consider which features you liked more - perhaps one was better at creative writing while the other excelled at explaining technical concepts.

Step 8: Compare and Decide

Based on your analysis, decide which AI assistant you prefer for your needs. Consider factors like:

  • How well each AI handles the types of questions you typically ask
  • Response speed and quality
  • Whether one is easier to use or understand

Remember that both are powerful tools, and the best choice depends on your specific needs and preferences.

Summary

In this tutorial, you've learned how to set up accounts on both ChatGPT and Claude, run identical tests on 10 different tasks, and compare their performance. This hands-on approach gives you real experience with both AI platforms and helps you make an informed decision about which one might work better for your specific needs. The key is to use the exact same prompts on both platforms to ensure fair comparison, and to pay attention to how each AI handles different types of questions.

Whether you choose ChatGPT, Claude, or both, you now have the practical skills to evaluate AI assistants based on your own experience rather than just relying on others' opinions.

Source: ZDNet AI

Related Articles