novels.fun
robots.txt
Robots Exclusion Standard data for novels.fun
Resource Scan
Scan Details
Site Domain | novels.fun |
Base Domain | novels.fun |
Scan Status | Ok |
Last Scan | 2024-11-13T01:22:34+00:00 |
Next Scan | 2024-11-20T01:22:34+00:00 |
Last Scan
Scanned | 2024-11-13T01:22:34+00:00 |
URL | https://novels.fun/robots.txt |
Domain IPs | 104.21.14.231, 172.67.160.191, 2606:4700:3030::6815:ee7, 2606:4700:3031::ac43:a0bf |
Response IP | 172.67.160.191 |
Found | Yes |
Hash | a2b591e4921092123dbe5a7152325f6ff22d8437871cc7513ac0b45cda9e4efb |
SimHash | 6900884289b7 |
Groups
*
Rule | Path |
---|---|
Disallow | */cgi-bin/ |
Disallow | */wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.ewtnet.com/sitemap_index.xml |