gajizmo.com
robots.txt

Robots Exclusion Standard data for gajizmo.com

Resource Scan

Scan Details

Site Domain gajizmo.com
Base Domain gajizmo.com
Scan Status Ok
Last Scan2024-09-24T18:27:14+00:00
Next Scan 2024-10-01T18:27:14+00:00

Last Scan

Scanned2024-09-24T18:27:14+00:00
URL https://gajizmo.com/robots.txt
Domain IPs 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c
Response IP 104.16.151.108
Found Yes
Hash 5c01503187e5024ddf514f469bbeac57d8d546619dcba1361e29d733af35ae3b
SimHash ce06cc6091b1

Groups

*

Rule Path
Disallow /?*
Disallow /search/*
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /*.html$
Allow /wp-admin/admin-ajax.php

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gajizmo.com/sitemap_index.xml