amazingtalker.es
robots.txt

Robots Exclusion Standard data for amazingtalker.es

Resource Scan

Scan Details

Site Domain amazingtalker.es
Base Domain amazingtalker.es
Scan Status Ok
Last Scan2024-11-05T23:20:29+00:00
Next Scan 2024-11-19T23:20:29+00:00

Last Scan

Scanned2024-11-05T23:20:29+00:00
URL https://amazingtalker.es/robots.txt
Redirect https://www.amazingtalker.es/robots.txt
Redirect Domain www.amazingtalker.es
Redirect Base amazingtalker.es
Domain IPs 18.155.68.120, 18.155.68.4, 18.155.68.42, 18.155.68.61
Redirect IPs 18.155.68.120, 18.155.68.4, 18.155.68.42, 18.155.68.61
Response IP 18.155.68.4
Found Yes
Hash 0975b86d81b4d264f80d7b4621278a3f7f02940ea183d65f803109ed34204338
SimHash aa68da40e21b

Groups

facebookexternalhit

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

gptbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

claudebot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

ahrefsbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*