pasteone.com
robots.txt
Robots Exclusion Standard data for pasteone.com
Resource Scan
Scan Details
| Site Domain | pasteone.com |
| Base Domain | pasteone.com |
| Scan Status | Ok |
| Last Scan | 2026-01-05T22:43:56+00:00 |
| Next Scan | 2026-01-12T22:43:56+00:00 |
Last Scan
| Scanned | 2026-01-05T22:43:56+00:00 |
| URL | https://pasteone.com/robots.txt |
| Domain IPs | 104.21.45.221, 172.67.219.131, 2606:4700:3032::6815:2ddd, 2606:4700:3035::ac43:db83 |
| Response IP | 104.21.45.221 |
| Found | Yes |
| Hash | d67a25d4f24c0ac50cb8bfea44d801cee41869b9371febba40e6e94452db5f98 |
| SimHash | 490057454c61 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /app/ |
| Disallow | /embed/ |
| Disallow | /archive/ |
| Disallow | /bootstrap/ |
| Disallow | /config/ |
| Disallow | /database/ |
| Disallow | /node_modules/ |
| Disallow | /lang/ |
| Disallow | /resources/ |
| Disallow | /routes/ |
| Disallow | /storage/ |
| Disallow | /tests/ |
| Disallow | /vendor/ |
| Disallow | /upload_files/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pasteone.com/sitemap.xml |
| sitemap | https://pasteone.com/sitemap-main.xml |