freewebnovels.net
robots.txt

Robots Exclusion Standard data for freewebnovels.net

Resource Scan

Scan Details

Site Domain freewebnovels.net
Base Domain freewebnovels.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-08T17:45:47+00:00
Next Scan 2025-04-08T17:45:47+00:00

Last Successful Scan

Scanned2023-08-10T04:30:21+00:00
URL https://freewebnovels.net/robots.txt
Redirect https://newcomics.net/robots.txt
Redirect Domain newcomics.net
Redirect Base newcomics.net
Domain IPs 104.21.9.167, 172.67.161.10, 2606:4700:3034::6815:9a7, 2606:4700:3034::ac43:a10a
Redirect IPs 104.21.34.249, 172.67.166.165, 2606:4700:3033::6815:22f9, 2606:4700:3035::ac43:a6a5
Response IP 172.67.166.165
Found Yes
Hash 9a06e799eac287bcb97f4a42fbd7bddd902b131ba5d76c6cba92942266a3e78a
SimHash 4100484049b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://newcomics.net/wp-sitemap.xml