mojopages.com
robots.txt

Robots Exclusion Standard data for mojopages.com

Resource Scan

Scan Details

Site Domain mojopages.com
Base Domain mojopages.com
Scan Status Ok
Last Scan2024-10-29T04:56:09+00:00
Next Scan 2024-11-05T04:56:09+00:00

Last Scan

Scanned2024-10-29T04:56:09+00:00
URL https://mojopages.com/robots.txt
Domain IPs 104.21.34.75, 172.67.156.28, 2606:4700:3030::ac43:9c1c, 2606:4700:3032::6815:224b
Response IP 172.67.156.28
Found Yes
Hash adb76ca8410d4a6fc373ffbdc2a91aa46ef12bc50676c3b2cf7a58df59c8bc12
SimHash 861d11801722

Groups

*
searchmetricsbot
applebot
bingbot
googlebot
googlebot-image
googlebot-news
googlebot-mobile
adsbot-google

Rule Path
Disallow /rc
Disallow /rc/
Disallow /page/*
Disallow /rc/0
Disallow /rc/1
Disallow /rc/2
Disallow /rc/3
Disallow /rc/4
Disallow /rc/5
Disallow /rc/6
Disallow /rc/7
Disallow /rc/8
Disallow /rc/9
Disallow /rc/9
Disallow /1?c=
Disallow /rm/
Disallow /c/
Disallow /?c=
Disallow /c%3D
Disallow /*?shopnow=
Disallow /*?copy=
Disallow /?

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

grok

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Comments

  • بِسْÙ
  • سلاÙ

Warnings

  • 4 invalid lines.