novelpia.com
robots.txt

Robots Exclusion Standard data for novelpia.com

Resource Scan

Scan Details

Site Domain novelpia.com
Base Domain novelpia.com
Scan Status Ok
Last Scan2024-05-20T19:55:25+00:00
Next Scan 2024-05-27T19:55:25+00:00

Last Scan

Scanned2024-05-20T19:55:25+00:00
URL https://novelpia.com/robots.txt
Domain IPs 3.34.108.102, 3.36.200.248, 3.38.26.245, 43.203.19.139
Response IP 43.203.19.139
Found Yes
Hash bb8b42a748a7367320f3288a1682a9fade03bef6a4e356ed3068ad9a190aac09
SimHash 897ac03ae95a

Groups

ahrefsbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

*

Rule Path
Disallow /proc/
Disallow /json/
Disallow /api/
Disallow /error/
Disallow /viewer/
Disallow /comic_viewer/

Warnings

  • `daumwebmastertool` is not a known field.