merahputih.com
robots.txt

Robots Exclusion Standard data for merahputih.com

Resource Scan

Scan Details

Site Domain merahputih.com
Base Domain merahputih.com
Scan Status Ok
Last Scan2024-11-02T19:11:24+00:00
Next Scan 2024-11-09T19:11:24+00:00

Last Scan

Scanned2024-11-02T19:11:24+00:00
URL https://merahputih.com/robots.txt
Redirect https://www.merahputih.com/robots.txt
Redirect Domain www.merahputih.com
Redirect Base merahputih.com
Domain IPs 104.21.87.240, 172.67.148.175, 2606:4700:3032::6815:57f0, 2606:4700:3032::ac43:94af
Redirect IPs 104.21.87.240, 172.67.148.175, 2606:4700:3032::6815:57f0, 2606:4700:3032::ac43:94af
Response IP 104.21.87.240
Found Yes
Hash b2af13c33b424e0aee9ec6af8653bc5e138a6fe089212b63d4efa0cc787f90b8
SimHash 4b2c50749170

Groups

*
googlebot
googlebot-news

Rule Path
Disallow /search?q*

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /post/ajaxtag/

Other Records

Field Value
sitemap https://www.merahputih.com/sitemap.xml