aicerts.ai
robots.txt

Robots Exclusion Standard data for aicerts.ai

Resource Scan

Scan Details

Site Domain aicerts.ai
Base Domain aicerts.ai
Scan Status Ok
Last Scan2025-10-16T00:59:05+00:00
Next Scan 2025-11-15T00:59:05+00:00

Last Scan

Scanned2025-10-16T00:59:05+00:00
URL https://aicerts.ai/robots.txt
Domain IPs 172.177.40.139
Response IP 172.177.40.139
Found Yes
Hash 5cb949a53d43964914d3a29e25aa8e8fdfc1976f9d7045a87b3ec87f2cf03cab
SimHash 6c190159c0b0

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /practice-area/
Disallow /wp-admin/
Disallow /ai-legal-lp-2/
Disallow /ai-healthcare-lp-1/
Disallow /ai-healthcare-lp/
Disallow /ai-legal-course-lp/
Disallow /ai-prompt-engineer-lp/
Disallow /ai-educator-3/
Disallow /atp-training-plus-institute/

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

yahooseeker/m1a1-r2d2

Rule Path
Allow /

msnbot-mobile

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

anthropicbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

youbot

Rule Path
Allow /

omgilibot

Rule Path
Allow /

omgili

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

duckassistbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

gemini

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.aicerts.ai/sitemap.xml