nikkan-gendai.com
robots.txt

Robots Exclusion Standard data for nikkan-gendai.com

Resource Scan

Scan Details

Site Domain nikkan-gendai.com
Base Domain nikkan-gendai.com
Scan Status Ok
Last Scan2024-06-13T19:36:59+00:00
Next Scan 2024-06-20T19:36:59+00:00

Last Scan

Scanned2024-06-13T19:36:59+00:00
URL https://nikkan-gendai.com/robots.txt
Redirect https://www.nikkan-gendai.com/robots.txt
Redirect Domain www.nikkan-gendai.com
Redirect Base nikkan-gendai.com
Domain IPs 115.31.193.156
Redirect IPs 115.31.193.156
Response IP 115.31.193.156
Found Yes
Hash 704dc0c80552ff49e7e3f151510db94919ef515f82ba11202103d5471c518e57
SimHash a90dca0289d2

Groups

googlebot-news

Rule Path
Disallow /pages/
Disallow /forms/
Disallow /users/
Disallow /purchases/

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nikkan-gendai.com/sitemap.xml