A recent analysis of arXiv submissions found that over 30% of new papers exhibit detectable AI writing patterns. The findings first appeared in a Hacker News thread that drew 100 points and 65 comments.
Scale of the Shift
The study examined recent uploads across multiple categories. Computer science and machine learning sections showed the highest rates, exceeding the overall 30% average. Earlier estimates from 2022 placed AI-assisted text below 10% in the same corpus.
Detection Method
The approach relies on statistical markers such as token probability distributions and sentence-level perplexity scores. These signals flag text generated by current large language models without requiring access to the original model weights. The method was calibrated against known human-written and AI-generated samples from prior years.
Key Numbers Reported
- 30%+ of new submissions flagged overall
- Highest concentration in cs.AI and cs.LG categories
- 65 comments on the Hacker News thread discussing methodology
- 100 points accumulated within the first day of posting
| Category | Estimated AI Rate | Change Since 2022 |
|---|---|---|
| cs.AI | 38% | +28 points |
| cs.LG | 35% | +25 points |
| Physics | 22% | +14 points |
| Mathematics | 18% | +11 points |
Detection Tools Compared
Several public detectors exist for checking similar patterns. ZeroGPT and GPTZero focus on probability curvature. Originality.ai adds citation and style consistency checks. The arXiv study method differs by operating on full-document statistics rather than sentence fragments.
Who Should Track This
Researchers preparing submissions to competitive venues need to review their drafting process. Journals and conferences evaluating policy on AI assistance can use the numbers to set thresholds. Reviewers spotting unusually uniform prose now have aggregate data to reference when raising questions.
Practical Next Steps
Run any draft through at least two independent detectors before submission. Keep version history that shows human edits and source notes. For borderline cases, add explicit statements on AI tool usage in the acknowledgments section.
Bottom line: arXiv now contains a measurable volume of AI-generated text that existing statistical tools can surface at scale.
The trend will force clearer disclosure rules and better detection benchmarks within the next submission cycle.
Top comments (0)