Log In Sign Up

maxmypoint.com
robots.txt

Robots Exclusion Standard data for maxmypoint.com

Resource Scan

Scan Details

Site Domain maxmypoint.com
Base Domain maxmypoint.com
Scan Status Ok
Last Scan2024-11-14T03:43:30+00:00
Next Scan 2024-11-21T03:43:30+00:00

Last Scan

Scanned2024-11-14T03:43:30+00:00
URL https://maxmypoint.com/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.34.21
Found Yes
Hash e9fe95cc973688210817fb4d8e3a4332503409da7c5820de5d9eb1e303a23306
SimHash c8441fc02451

Groups

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

criteobot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

ias-va

Rule Path
Disallow /

ias-va/3.1

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

ias-or

Rule Path
Disallow /

ias-or/3.1

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

ias-ir

Rule Path
Disallow /

ias-ir/3.1

Rule Path
Disallow /

yandex

Rule Path Comment
Disallow / prohibits crawling for the entire site

maxpointcrawler

Rule Path Comment
Disallow / prohibits crawling for the entire site

nutch

Rule Path Comment
Disallow / prohibits crawling for the entire site
Back to top

Comments

  • Block Uptime robot
  • Block Uptime robot
Back to top