paagman.nl
robots.txt
Robots Exclusion Standard data for paagman.nl
Resource Scan
Scan Details
| Site Domain | paagman.nl |
| Base Domain | paagman.nl |
| Scan Status | Ok |
| Last Scan | 2024-06-18T21:14:53+00:00 |
| Next Scan | 2024-07-18T21:14:53+00:00 |
Last Scan
| Scanned | 2024-06-18T21:14:53+00:00 |
| URL | https://paagman.nl/robots.txt |
| Redirect | https://www.paagman.nl/robots.txt |
| Redirect Domain | www.paagman.nl |
| Redirect Base | paagman.nl |
| Domain IPs | 104.21.11.49, 172.67.165.41, 2606:4700:3033::6815:b31, 2606:4700:3037::ac43:a529 |
| Redirect IPs | 104.21.11.49, 172.67.165.41, 2606:4700:3033::6815:b31, 2606:4700:3037::ac43:a529 |
| Response IP | 104.21.11.49 |
| Found | Yes |
| Hash | ccb9914e6c6074cdfd75314ea3b3653d4b3e73029afb3a7e6704f05b89835582 |
| SimHash | 4c48d9b0cee0 |
Groups
facebookexternalhit/1.0
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
screaming frog seo spider
| Rule | Path |
|---|---|
| Disallow | /?id=* |
| Disallow | /rightclick.cfm?id=* |
| Disallow | /rightclick-ajax.cfm?id=autosuggest* |
| Disallow | /*?*orderby=* |
| Disallow | /*?*fattr_paagman_uitgave=* |
| Disallow | /*?*currentEditAttribute=* |
| Disallow | /*?*term=* |
| Disallow | /*?*merk=* |
| Disallow | /*?*auteur=* |
| Disallow | /*?*catid=* |
| Disallow | /*?*maincatid=* |
| Disallow | /*?*store_id=* |
| Disallow | /*?*ec_showinclvat=* |
| Disallow | /inloggen |
| Disallow | /winkelwagen |
| Disallow | /wachtwoord-vergeten |
| Disallow | /aanmelden |
| Disallow | /sitemaps/shop90_sitemap_index.xml |
| Disallow | /*?*rc_lang=* |
| Disallow | /*?$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /?id=* |
| Disallow | /rightclick.cfm?id=* |
| Disallow | /rightclick-ajax.cfm?id=autosuggest* |
| Disallow | /*?*orderby=* |
| Disallow | /*?*fattr_paagman_uitgave=* |
| Disallow | /*?*currentEditAttribute=* |
| Disallow | /*?*term=* |
| Disallow | /*?*merk=* |
| Disallow | /*?*auteur=* |
| Disallow | /*?*catid=* |
| Disallow | /*?*maincatid=* |
| Disallow | /*?*store_id=* |
| Disallow | /*?*ec_showinclvat=* |
| Disallow | /*?*rc_lang=* |
| Disallow | /*?$ |
| Disallow | /inloggen |
| Disallow | /winkelwagen |
| Disallow | /wachtwoord-vergeten |
| Disallow | /aanmelden |
| Disallow | /sitemaps/shop90_sitemap_index.xml |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.paagman.nl/sitemap.xml |