perfectgift.com
robots.txt

Robots Exclusion Standard data for perfectgift.com

Resource Scan

Scan Details

Site Domain perfectgift.com
Base Domain perfectgift.com
Scan Status Ok
Last Scan2024-06-08T06:01:22+00:00
Next Scan 2024-06-22T06:01:22+00:00

Last Scan

Scanned2024-06-08T06:01:22+00:00
URL https://perfectgift.com/robots.txt
Redirect https://www.perfectgift.com/robots.txt
Redirect Domain www.perfectgift.com
Redirect Base perfectgift.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.9, 76.76.21.98
Response IP 76.76.21.142
Found Yes
Hash 2491ffa341dc7faa21b52a13807b89aa99cda88f4406372d0c5ef420ae174e9b
SimHash 6854d2c0d6b0

Groups

*

Rule Path
Disallow /404
Disallow /kiosk
Disallow /demo-page
Disallow /cardActivate
Disallow /api/*
Disallow /edit-builder-symbol
Disallow /test/*
Disallow /~partytown/*
Disallow /_next/*
Disallow /search
Disallow /r/*
Disallow /claim/*
Disallow /redeem/*
Disallow /account
Disallow /account/*
Disallow /verify/*
Disallow /lp/*
Disallow /corporate/get-started/*
Disallow /captcha
Disallow /corporate/american-express
Disallow /auth-action-handler
Disallow /auth-action-handler/*

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /_next/*

updownerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

yahoo pipes 2.0

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.perfectgift.com/sitemap.xml

Comments

  • *
  • AdsBot-Google
  • Googlebot
  • Updownerbot
  • MJ12bot
  • 008
  • Yahoo Pipes 1.0
  • Yahoo Pipes 2.0
  • Fasterfox
  • Mediapartners-Google
  • Host
  • Sitemaps

Warnings

  • 2 invalid lines.
  • `host` is not a known field.