bengkuluekspress.disway.id
robots.txt

Robots Exclusion Standard data for bengkuluekspress.disway.id

Resource Scan

Scan Details

Site Domain bengkuluekspress.disway.id
Base Domain disway.id
Scan Status Ok
Last Scan2024-05-18T01:28:47+00:00
Next Scan 2024-06-17T01:28:47+00:00

Last Scan

Scanned2024-05-18T01:28:47+00:00
URL https://bengkuluekspress.disway.id/robots.txt
Domain IPs 104.26.14.37, 104.26.15.37, 172.67.75.73, 2606:4700:20::681a:e25, 2606:4700:20::681a:f25, 2606:4700:20::ac43:4b49
Response IP 104.26.15.37
Found Yes
Hash 22871600838a9b0a67c75ddb7831f4db5788142ba22bd54fb82a1afb61e03b6e
SimHash 495d18d335d7

Groups

*
googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://bengkuluekspress.disway.id/sitemap.xml
sitemap https://bengkuluekspress.disway.id/sitemap/index.xml
sitemap https://bengkuluekspress.disway.id/sitemap/image.xml
sitemap https://bengkuluekspress.disway.id/sitemap/tag.xml
sitemap https://bengkuluekspress.disway.id/frontend/sitemapgoogle
sitemap https://bengkuluekspress.disway.id/frontend/sitemap