reqres.in
robots.txt
Robots Exclusion Standard data for reqres.in
Resource Scan
Scan Details
Site Domain | reqres.in |
Base Domain | reqres.in |
Scan Status | Ok |
Last Scan | 2025-08-28T04:27:53+00:00 |
Next Scan | 2025-09-27T04:27:53+00:00 |
Last Scan
Scanned | 2025-08-28T04:27:53+00:00 |
URL | https://reqres.in/robots.txt |
Domain IPs | 104.26.10.213, 104.26.11.213, 172.67.73.173, 2606:4700:20::681a:ad5, 2606:4700:20::681a:bd5, 2606:4700:20::ac43:49ad |
Response IP | 104.26.10.213 |
Found | Yes |
Hash | 40b9d138cd985fc2ee180c1380c359073c0dd9ef1fd188a0f74ffb9e8387d9b1 |
SimHash | 0304c272b731 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /private/ |
Disallow | /api/private/ |
Disallow | /api/keys/ |
Disallow | /api/projects/*/usage |
Allow | /api-docs/ |
Allow | /docs/ |
Allow | /api/users/ |
Allow | /api/users/*/ |
Allow | /api/unknown/ |
Allow | /api/custom/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://reqres.in/sitemap.xml |
Comments