giftya.com
robots.txt

Robots Exclusion Standard data for giftya.com

Resource Scan

Scan Details

Site Domain giftya.com
Base Domain giftya.com
Scan Status Ok
Last Scan2024-08-27T08:33:51+00:00
Next Scan 2024-09-26T08:33:51+00:00

Last Scan

Scanned2024-08-27T08:33:51+00:00
URL https://giftya.com/robots.txt
Redirect https://www.giftya.com/robots.txt
Redirect Domain www.giftya.com
Redirect Base giftya.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.61, 76.76.21.9
Response IP 76.76.21.93
Found Yes
Hash c057364a9305ebb3d3d182f22a8126156867c74d7917bcc22d3cde589e2faf10
SimHash a9549240c6b0

Groups

*

Rule Path
Disallow /buy/select-wrapper
Disallow /buy/customize
Disallow /cart/
Disallow /checkout
Disallow /secure/
Disallow /brandsnext/
Disallow /homenext/
Disallow /?denom*

bingbot

Rule Path
Disallow /buy/select-wrapper
Disallow /buy/customize
Disallow /cart/
Disallow /checkout
Disallow /secure/
Disallow /?denom*

facebookexternalhit

Rule Path
Disallow /buy/select-wrapper
Disallow /buy/customize
Disallow /cart/
Disallow /checkout
Disallow /secure/
Disallow /?denom*

facebot

Rule Path
Disallow /buy/select-wrapper
Disallow /buy/customize
Disallow /cart/
Disallow /checkout
Disallow /secure/
Disallow /?denom*

updownerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

yahoo pipes 2.0

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

jamesbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.giftya.com/sitemap.xml

Warnings

  • 2 invalid lines.