tbsgraduates.net
robots.txt

Robots Exclusion Standard data for tbsgraduates.net

Resource Scan

Scan Details

Site Domain tbsgraduates.net
Base Domain tbsgraduates.net
Scan Status Ok
Last Scan2024-11-14T10:00:42+00:00
Next Scan 2024-11-21T10:00:42+00:00

Last Scan

Scanned2024-11-14T10:00:42+00:00
URL https://tbsgraduates.net/robots.txt
Domain IPs 104.21.62.218, 172.67.139.152, 2606:4700:3034::6815:3eda, 2606:4700:3037::ac43:8b98
Response IP 172.67.139.152
Found Yes
Hash 5ed38a212153942e81fba3edf4df44b0ef877aa814201cb9c017ecdc77669d23
SimHash 0815dc1147b0

Groups

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

twiceler

Rule Path
Allow /

gigabot

Rule Path
Allow /

scrubby

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes
Disallow /wp-content/themes/sloth/
Disallow /readme.html
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://graduates.tbsnews.net/sitemap_index.xml