api.amazingtalker.com
robots.txt

Robots Exclusion Standard data for api.amazingtalker.com

Resource Scan

Scan Details

Site Domain api.amazingtalker.com
Base Domain amazingtalker.com
Scan Status Ok
Last Scan2024-11-08T03:23:35+00:00
Next Scan 2024-11-22T03:23:35+00:00

Last Scan

Scanned2024-11-08T03:23:35+00:00
URL https://api.amazingtalker.com/robots.txt
Domain IPs 18.155.68.120, 18.155.68.4, 18.155.68.42, 18.155.68.61
Response IP 18.155.68.61
Found Yes
Hash 0975b86d81b4d264f80d7b4621278a3f7f02940ea183d65f803109ed34204338
SimHash aa68da40e21b

Groups

facebookexternalhit

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

gptbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

claudebot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 300

ahrefsbot

Rule Path
Disallow /*?*city=
Disallow /*/*?city=
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /tutors-debug
Disallow /webview/
Disallow /_Incapsula_Resource
Disallow /sdk.js
Disallow /courses-legacy
Disallow /landing
Disallow /_s/videos/
Disallow /entrances/
Disallow /int-a/
Disallow /messenger/
Disallow /users/*
Disallow /*/users/*
Disallow /learning-tickets/*
Disallow /ratings/*/*
Disallow /blog/tag/*
Disallow /blog/category/*
Disallow /dashboard/*
Disallow /u/*
Disallow /t/*