frizbiz.com
robots.txt
Robots Exclusion Standard data for frizbiz.com
Resource Scan
Scan Details
| Site Domain | frizbiz.com |
| Base Domain | frizbiz.com |
| Scan Status | Ok |
| Last Scan | 2024-05-19T05:03:30+00:00 |
| Next Scan | 2024-06-02T05:03:30+00:00 |
Last Scan
| Scanned | 2024-05-19T05:03:30+00:00 |
| URL | https://frizbiz.com/robots.txt |
| Redirect | https://www.frizbiz.com/robots.txt |
| Redirect Domain | www.frizbiz.com |
| Redirect Base | frizbiz.com |
| Domain IPs | 18.155.68.10, 18.155.68.114, 18.155.68.72, 18.155.68.93 |
| Redirect IPs | 108.156.133.44, 108.156.133.72, 108.156.133.78, 108.156.133.90, 2600:9000:2755:4800:e:c693:2640:93a1, 2600:9000:2755:6c00:e:c693:2640:93a1, 2600:9000:2755:6e00:e:c693:2640:93a1, 2600:9000:2755:7600:e:c693:2640:93a1, 2600:9000:2755:b200:e:c693:2640:93a1, 2600:9000:2755:d600:e:c693:2640:93a1, 2600:9000:2755:f000:e:c693:2640:93a1, 2600:9000:2755:fe00:e:c693:2640:93a1 |
| Response IP | 108.156.133.72 |
| Found | Yes |
| Hash | 574ad04ee018ebefa3667cf0780bf2247fc8968415a7e900e457e90fa61a4730 |
| SimHash | 031cfa52c313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /fr/profil-* |
| Disallow | /fr/p/paiement |
| Disallow | /fr/p/cg |
| Disallow | /fr/p/charte |
| Disallow | /fr/p/garantie-jobbing-axa |
| Disallow | /fr/p/evaluation |
| Disallow | /fr/p/mentions-legales |
| Disallow | /fr/worker_profiles/ |
| Disallow | /fr/seller_profiles/ |
| Disallow | /fr/leads/ |
| Disallow | /health_check |
| Disallow | /*?city_placeholder=*&latitude=*&longitude=*&page=*&sortMode=*&sortType=* |
| Disallow | /*/ajax_search |
| Disallow | /fr/prestataires/ |
| Disallow | /fr/worker/jobs |
| Disallow | /fr/categories?* |
| Disallow | *? |
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.frizbiz.com/sitemap.xml |