← Back to feed

I prompted ChatGPT, Claude, Perplexity, and Gemini and watched my Nginx logs

L3 · BuilderTutorials & GuidesHacker News· 4/20/2026

Power users and builders need this to understand AI traffic patterns, optimize their logging/analytics, and distinguish between direct model indexing and user referrals—critical for SEO, traffic attribution, and content strategy.

AI Summary

A detailed technical investigation using nginx logs to trace how ChatGPT, Claude, Perplexity, Gemini, Copilot, and Grok actually fetch web content. The author discovered that some assistants announce themselves with distinct user-agents while others masquerade as regular browsers, and that AI traffic splits into two categories: direct model fetches versus human clickthroughs from AI-generated citations.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L2 · PractitionerTutorials & GuidesTowards Data Science
Avoiding Entity Key Drift in a Data Lake: Step 2, When Fuzzy Matching Stops Working

When fuzzy matching algorithms like Damerau-Levenshtein fail to distinguish typos from legitimately similar product identifiers, requiring alternative approaches for entity reconciliation.

L4 · DeveloperTutorials & GuidesTowards Data Science
Graph Neural Networks: GCN, MPNN, and GAT, Explained Simply

This article explains three key Graph Neural Network architectures - GCN, MPNN, and GAT - with practical applications in molecular science, social networks, and traffic analysis.

L3 · BuilderTutorials & GuidesTowards Data Science
A RAG That Says “Not in This Document” Has to Show Four Kinds of Evidence

Explains how to make RAG systems provide defensible 'I don't know' responses with four specific evidence types to verify non-existence of information.

L3 · BuilderTutorials & GuidesTowards Data Science
A Practical Introduction to PySpark Window Functions

PySpark window functions enable aggregations like rankings and running totals while preserving individual row details.

L4 · DeveloperTutorials & GuidesTowards Data Science
Your LLM Can Return Perfect JSON and Still Be Wrong

Structured outputs can produce valid JSON with incorrect data when fields are missing from source text, creating silent data corruption issues that bypass validation.