amazingtalker.fr
robots.txt

Robots Exclusion Standard data for amazingtalker.fr

Resource Scan

Scan Details

Site Domain amazingtalker.fr
Base Domain amazingtalker.fr
Scan Status Ok
Last Scan2024-09-26T19:23:59+00:00
Next Scan 2024-10-10T19:23:59+00:00

Last Scan

Scanned2024-09-26T19:23:59+00:00
URL https://amazingtalker.fr/robots.txt
Redirect https://www.amazingtalker.fr/robots.txt
Redirect Domain www.amazingtalker.fr
Redirect Base amazingtalker.fr
Domain IPs 18.155.68.120, 18.155.68.4, 18.155.68.42, 18.155.68.61
Redirect IPs 54.230.71.115, 54.230.71.118, 54.230.71.25, 54.230.71.50
Response IP 18.155.68.42
Found Yes
Hash 1644d32722f75a385427791cd91d6a49a22b6c0cbd575f41be3c37d80c7bdb53
SimHash 2968db40e613

Groups

facebookexternalhit

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

gptbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

claudebot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

amazonbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*