worldwidemedia.in
robots.txt

Robots Exclusion Standard data for worldwidemedia.in

Resource Scan

Scan Details

Site Domain worldwidemedia.in
Base Domain worldwidemedia.in
Scan Status Ok
Last Scan2024-09-08T05:39:34+00:00
Next Scan 2024-10-08T05:39:34+00:00

Last Scan

Scanned2024-09-08T05:39:34+00:00
URL https://worldwidemedia.in/robots.txt
Redirect https://www.worldwidemedia.in/robots.txt
Redirect Domain www.worldwidemedia.in
Redirect Base worldwidemedia.in
Domain IPs 20.33.56.65
Redirect IPs 20.33.56.65
Response IP 20.33.56.65
Found Yes
Hash ad68931a08a8af3d0150c7a3acc6a05c5fa41f5beb069a212167b163d8eb4517
SimHash 18049920e931

Groups

*

Rule Path
Allow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /