spotvnews.jp
robots.txt

Robots Exclusion Standard data for spotvnews.jp

Resource Scan

Scan Details

Site Domain spotvnews.jp
Base Domain spotvnews.jp
Scan Status Ok
Last Scan2024-06-14T23:34:19+00:00
Next Scan 2024-06-21T23:34:19+00:00

Last Scan

Scanned2024-06-14T23:34:19+00:00
URL https://spotvnews.jp/robots.txt
Redirect https://www.spotvnews.jp/robots.txt
Redirect Domain www.spotvnews.jp
Redirect Base spotvnews.jp
Domain IPs 118.67.142.212
Redirect IPs 27.96.133.146, 27.96.133.188
Response IP 27.96.133.188
Found Yes
Hash 95f88d254f9cff2739f3dd19db416e0eb257f6a2c31dea5c2a923319a7b8b26f
SimHash 69110884c295

Groups

*

Rule Path
Disallow /admin/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.spotvnews.jp/sitemap.xml