groupon.nl
robots.txt

Robots Exclusion Standard data for groupon.nl

Resource Scan

Scan Details

Site Domain groupon.nl
Base Domain groupon.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-10T11:16:39+00:00
Next Scan 2024-06-24T11:16:39+00:00

Last Successful Scan

Scanned2024-04-14T11:14:36+00:00
URL https://groupon.nl/robots.txt
Redirect https://www.groupon.nl/robots.txt
Redirect Domain www.groupon.nl
Redirect Base groupon.nl
Domain IPs 23.9.67.176
Redirect IPs 23.52.113.121
Response IP 23.54.57.183
Found Yes
Hash 3b3ea21f079b5f5e3dce8dbe0dcfd4f0b9b98380565bd28ff942bc1e0e2dddfc
SimHash 4d14ac36df9f

Groups

adsbot-google
adsbot-google-mobile

Rule Path
Disallow /sites/www.groupon.nl/lp/creative-img/

uptimebot
ia_archiver

Rule Path
Disallow *

archive.org_bot

Rule Path
Disallow /login

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /login
Disallow /signup
Disallow /partial
Allow */get-lazy-loaded-cards
Allow */get-page-header-and-facets
Allow */get-paginated-cards
Disallow */showads.js
Disallow /deals/mttl4bos7k-
Disallow /merchant/*/contracts/*
Disallow /*d47388
Disallow /*t31337
Disallow /browse/deals/partial
Disallow /deals/update_deal_status
Disallow /deals/*/memberships
Disallow /users/
Disallow /user$
Disallow /user?
Disallow /user/
Disallow /local/grouber.html
Disallow /sub-sections/
Disallow /search/
Disallow /getaways/tripadvisor
Disallow /deals/tripadvisor
Disallow /gifts/*/print
Disallow /groupon_says/
Disallow /campaigns/
Disallow /analytic/
Disallow /admin/
Disallow /adminusers/
Disallow /administrator/
Disallow /api/
Disallow /biz_photos/
Disallow /community/
Disallow /deals/now/
Disallow /ews/
Disallow /forgot_password
Disallow /places/
Disallow /profile/
Disallow */redirect/
Disallow /session/
Disallow /v1/
Disallow /v2/
Disallow /unsubscribe
Disallow /unsubscribed
Disallow /cart
Disallow /tracky
Disallow /sites/
Disallow /lp/
Disallow /lpo/
Disallow /citynews/unsubscribe/
Disallow /deals/city/
Disallow /reservations/
Disallow /confirmation/
Disallow /confirmation?
Disallow /kortingsbonnen/*?*=*
Disallow /kortingsbonnen/*/local
Disallow /kortingsbonnen/*/all-deals
Disallow /kortingsbonnen/*/goods

Other Records

Field Value
sitemap https://www.groupon.nl/sitemap.xml

Comments

  • GSM: https://www.groupon.nl