programtalk.com
robots.txt

Robots Exclusion Standard data for programtalk.com

Resource Scan

Scan Details

Site Domain programtalk.com
Base Domain programtalk.com
Scan Status Ok
Last Scan2024-11-14T21:28:04+00:00
Next Scan 2024-11-21T21:28:04+00:00

Last Scan

Scanned2024-11-14T21:28:04+00:00
URL https://programtalk.com/robots.txt
Domain IPs 104.21.90.112, 172.67.200.97
Response IP 104.21.90.112
Found Yes
Hash 9a5631e0c693597b98c32775be5dd5ac29a58b8c4a2d16b9863204e2039b3103
SimHash 400441606135

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /vs2/
Disallow /vs2-amp/
Disallow /view-source/
Disallow /csharp-examples-amp/
Disallow /csharp-examples/
Disallow /java-api-usage-examples-amp/
Disallow /java-examples-amp/
Disallow /java-more-examples-amp/
Disallow /java-more-examples/
Disallow /python-examples-amp/
Disallow /python-more-examples-amp/
Disallow /r-examples/
Disallow /r-examples-amp/
Disallow /vs4/
Disallow /vs4-amp/
Disallow /vs3/
Disallow /vs3-amp/
Disallow /vs/
Disallow /vs-amp/
Disallow /python-how-to/
Disallow /python-how-to-amp/
Disallow /python-examples/
Disallow /python-more-examples/
Disallow /java-api-usage-examples/
Disallow /java-examples/
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /