unicpuffin.com
robots.txt

Robots Exclusion Standard data for unicpuffin.com

Resource Scan

Scan Details

Site Domain unicpuffin.com
Base Domain unicpuffin.com
Scan Status Ok
Last Scan2025-08-23T13:42:11+00:00
Next Scan 2025-09-22T13:42:11+00:00

Last Scan

Scanned2025-08-23T13:42:11+00:00
URL https://www.unicpuffin.com/robots.txt
Domain IPs 195.85.88.122
Response IP 195.85.88.122
Found Yes
Hash a44aaeeaa202a8be3f88af2587c834ab587c333e1a9698d9974e09961d513e3b
SimHash e515de1275c4

Groups

*

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /pages/intellectual-property-violation
Disallow /*theme_preview_id*
Disallow /checkout-additional

adsbot-google

Rule Path
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /*theme_preview_id*
Disallow /checkout-additional
Disallow /pages/intellectual-property-violation

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /pages/intellectual-property-violation
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /pages/intellectual-property-violation
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value Comment
sitemap https://www.unicpuffin.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://www.unicpuffin.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://www.unicpuffin.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.

Comments

  • Google adsbot ignores robots.txt unless specifically named!