entabe.jp
robots.txt

Robots Exclusion Standard data for entabe.jp

Resource Scan

Scan Details

Site Domain entabe.jp
Base Domain entabe.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-08T12:02:24+00:00
Next Scan 2025-02-06T12:02:24+00:00

Last Successful Scan

Scanned2024-07-12T12:00:45+00:00
URL https://entabe.jp/robots.txt
Domain IPs 13.231.77.17, 52.199.103.182
Response IP 52.199.103.182
Found Yes
Hash 1652aac5d092b709c7b5fdfe70d2209bb806556472a9286e14a3ab287ab28ded
SimHash 0904c823e5d1

Groups

*

Rule Path
Disallow /click/
Disallow /ad/
Disallow /smartnews_prs/

*
bingbot

Rule Path
Disallow /news/
Allow /news/article/
Allow /news/gourmet/

Other Records

Field Value
sitemap https://entabe.jp/xml/sitemap_index.xml