rewriteguru.com
robots.txt
Robots Exclusion Standard data for rewriteguru.com
Resource Scan
Scan Details
| Site Domain | rewriteguru.com |
| Base Domain | rewriteguru.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T19:01:22+00:00 |
| Next Scan | 2024-11-22T19:01:22+00:00 |
Last Scan
| Scanned | 2024-11-15T19:01:22+00:00 |
| URL | https://rewriteguru.com/robots.txt |
| Domain IPs | 104.26.8.250, 104.26.9.250, 172.67.71.225, 2606:4700:20::681a:8fa, 2606:4700:20::681a:9fa, 2606:4700:20::ac43:47e1 |
| Response IP | 104.26.9.250 |
| Found | Yes |
| Hash | cde47c947fa12ca5c8878a55d842513f94bc97c5d69594d8499bbc22258f84cc |
| SimHash | 640416632f87 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /assets |
| Disallow | /*?u_src=* |
| Disallow | /cdn-cgi/* |
| Disallow | /api/* |
| Disallow | /ajxupload/* |
| Disallow | /breaksentence/ |
| Disallow | /v1/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rewriteguru.com/sitemap.xml |