fiverr.com
robots.txt
Robots Exclusion Standard data for fiverr.com
Resource Scan
Scan Details
| Site Domain | fiverr.com |
| Base Domain | fiverr.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T07:14:27+00:00 |
| Next Scan | 2024-09-30T07:14:27+00:00 |
Last Scan
| Scanned | 2024-09-23T07:14:27+00:00 |
| URL | https://fiverr.com/robots.txt |
| Redirect | https://www.fiverr.com/robots.txt |
| Redirect Domain | www.fiverr.com |
| Redirect Base | fiverr.com |
| Domain IPs | 104.18.113.47, 104.18.114.47 |
| Redirect IPs | 104.18.113.47, 104.18.114.47 |
| Response IP | 104.18.114.47 |
| Found | Yes |
| Hash | 515345d2fefa8c498a918cbe98a3988a60a5a2beedbf648e32d19c8f2d27d703 |
| SimHash | 118961cfa76d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /orders/timeline/* |
| Disallow | /s/ |
| Disallow | */pinned_flashes/* |
| Disallow | /gigs/*/share/ |
| Disallow | /gigs/*/share?* |
| Disallow | /specials/* |
| Disallow | /packages/* |
| Disallow | /categories/silly |
| Disallow | /categories/fifa |
| Disallow | /categories/Halloween |
| Disallow | /categories/Postcards |
| Disallow | /purchases |
| Disallow | /user_sessions |
| Disallow | /users/ |
| Disallow | /counter/*? |
| Disallow | /collaborate/* |
| Disallow | /search/ |
| Disallow | /search_results/gigs/* |
| Disallow | /match/website/* |
| Disallow | /pages/website-developer-match |
| Disallow | /v4/* |
| Disallow | /pro/* |
| Disallow | /pro-resources |
| Disallow | /gigs/search |
| Disallow | /recommendations/ |
| Disallow | /contact_me/ |
| Disallow | /conversations/ |
| Disallow | /bookmarks/ |
| Disallow | /inbox/ |
| Disallow | /inbox$ |
| Disallow | /seller_onboarding/ |
| Disallow | /checkout/package/ |
| Disallow | /match/ |
| Disallow | /pages/website-developer-match |
| Disallow | /cdn-proxy/px/* |
| Disallow | /cdn-proxy/pim/* |
| Disallow | /search_results/ |
| Disallow | /custom_orders/ |
| Disallow | /studios/ |
| Disallow | /v1/stats |
| Disallow | /v1/browser-performance |
| Disallow | /assets/shared/* |
| Allow | /pro/about |
| Disallow | /gigs/*page%3D |
| Allow | /gigs/*page%3D2$ |
| Disallow | /*context_referrer%3Dgig_page |
| Disallow | /*?*source=user_page* |
| Disallow | /*context_referrer%3Duser_page |
| Disallow | /api/v1/activities |
| Disallow | /logo-maker/brief/ |
| Disallow | /logo-maker/choose-variation/ |
| Disallow | /logo-maker/wordpress |
| Disallow | /logo-maker/woo |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fiverr.com/sitemap_gigs.xml.gz |
| sitemap | https://www.fiverr.com/sitemap_users.xml.gz |
| sitemap | https://www.fiverr.com/sitemap_categories.xml.gz |
| sitemap | https://www.fiverr.com/sitemap_tags.xml.gz |
| sitemap | https://www.fiverr.com/sitemap_logomaker_tags.xml.gz |
Comments