m.reddit.com
robots.txt
Robots Exclusion Standard data for m.reddit.com
Resource Scan
Scan Details
Site Domain | m.reddit.com |
Base Domain | reddit.com |
Scan Status | Ok |
Last Scan | 2024-05-16T17:56:01+00:00 |
Next Scan | 2024-05-30T17:56:01+00:00 |
Last Scan
Scanned | 2024-05-16T17:56:01+00:00 |
URL | https://m.reddit.com/robots.txt |
Redirect | https://www.reddit.com/robots.txt |
Redirect Domain | www.reddit.com |
Redirect Base | reddit.com |
Domain IPs | 151.101.1.140, 151.101.129.140, 151.101.193.140, 151.101.65.140 |
Redirect IPs | 151.101.1.140, 151.101.129.140, 151.101.193.140, 151.101.65.140 |
Response IP | 151.101.21.140 |
Found | Yes |
Hash | d32110c3945e957c19f64aa3366d5cd09259a413b31c09a20a9bdb4db6638629 |
SimHash | 0417ebca6593 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.json |
Disallow | /*.json-compact |
Disallow | /*.json-html |
Disallow | /*.xml |
Disallow | /*.rss |
Allow | /r/*.rss |
Disallow | /r/*/search.rss |
Disallow | /r/*/comments/*.rss |
Disallow | /r/*/config/*.rss |
Disallow | /r/*/wiki/*.rss |
Disallow | /*.i |
Disallow | /*.embed |
Disallow | /*/comments/*?*sort= |
Disallow | */comment/* |
Allow | /r/*/comments/*/*/de/* |
Allow | /r/*/comments/*/*/es/* |
Allow | /r/*/comments/*/*/fr/* |
Allow | /r/*/comments/*/*/pt/* |
Allow | /r/*/comments/*/*/it/* |
Disallow | /r/*/comments/*/*/*/* |
Disallow | /r/*/submit$ |
Disallow | /r/*/submit/$ |
Disallow | /message/compose* |
Disallow | /api |
Disallow | /post |
Disallow | /submit |
Disallow | /goto |
Disallow | /*before%3D |
Disallow | /domain/*t%3D |
Disallow | /login |
Disallow | /remove_email/t2_* |
Disallow | /r/*/user/ |
Disallow | /gold? |
Disallow | /search$ |
Disallow | /search?q= |
Disallow | /search/ |
Disallow | /*/search? |
Disallow | /*/search/? |
Disallow | /*/search$ |
Disallow | /*/search/$ |
Disallow | /search.compact$ |
Disallow | /*/search.compact$ |
Allow | /r/*/comments/*/search/$ |
Allow | /r/*/comments/*/search$ |
Disallow | /static/button/button1.js |
Disallow | /static/button/button1.html |
Disallow | /static/button/button2.html |
Disallow | /static/button/button3.html |
Disallow | /subreddits/* |
Disallow | /buttonlite.js |
Disallow | /timings/perf |
Disallow | /counters/client-screenview |
Disallow | /*?*feed= |
Disallow | /svc/shreddit/* |
Disallow | /svc/sh/* |
Disallow | /svc/web/* |
Disallow | /graphql |
Disallow | /errors$ |
Disallow | /live/* |
Disallow | /mediaembed/* |
Disallow | /media |
Allow | / |
Allow | /sitemaps/*.xml |
Allow | /posts/* |
Warnings
- 2 invalid lines.
Comments