igzein.web.id
robots.txt

Robots Exclusion Standard data for igzein.web.id

Resource Scan

Scan Details

Site Domain igzein.web.id
Base Domain igzein.web.id
Scan Status Ok
Last Scan2024-06-18T07:06:36+00:00
Next Scan 2024-06-25T07:06:36+00:00

Last Scan

Scanned2024-06-18T07:06:36+00:00
URL https://www.igzein.web.id/robots.txt
Redirect https://www.ignelius.com/robots.txt
Redirect Domain www.ignelius.com
Redirect Base ignelius.com
Domain IPs 104.21.51.93, 172.67.178.29, 2606:4700:3034::ac43:b21d, 2606:4700:3035::6815:335d
Redirect IPs 142.251.175.121, 2404:6800:4003:c1c::79
Response IP 74.125.130.121
Found Yes
Hash 905be6bc75ea1b3f67742cf7aee3023f3017a9fe43aed4cc787518e10d8c650c
SimHash 6945995167d1

Groups

*

Rule Path
Allow /
Allow /ads.txt
Disallow /search

googlebot

Rule Path
Allow /
Allow /ads.txt
Disallow /search

bingbot

Rule Path
Allow /
Allow /ads.txt
Disallow /search

slurp

Rule Path
Allow /
Allow /ads.txt
Disallow /search

yandexbot

Rule Path
Allow /
Allow /ads.txt
Disallow /search

Other Records

Field Value
sitemap https://www.ignelius.com/sitemap.xml
sitemap https://www.ignelius.com/sitemap-pages.xml
sitemap https://www.ignelius.com/atom.xml
sitemap https://www.ignelius.com/feeds/posts/default?orderby=updated&max-results=999