gify.net
robots.txt

Robots Exclusion Standard data for gify.net

Resource Scan

Scan Details

Site Domain gify.net
Base Domain gify.net
Scan Status Ok
Last Scan2024-06-20T09:02:07+00:00
Next Scan 2024-06-27T09:02:07+00:00

Last Scan

Scanned2024-06-20T09:02:07+00:00
URL https://gify.net/robots.txt
Redirect https://www.gify.net/robots.txt
Redirect Domain www.gify.net
Redirect Base gify.net
Domain IPs 104.21.8.251, 172.67.188.219, 2606:4700:3030::6815:8fb, 2606:4700:3035::ac43:bcdb
Redirect IPs 104.21.8.251, 172.67.188.219, 2606:4700:3030::6815:8fb, 2606:4700:3035::ac43:bcdb
Response IP 172.67.188.219
Found Yes
Hash dcd22c806732c15d9f2fb98aff74b79dad428829d66c38efc273a9b6688d3e11
SimHash 611d5cc9d6f7

Groups

googlebot-image

Rule Path
Allow /*

*

Rule Path
Allow /
Disallow /*?l=english
Disallow /*?l=vietnam
Disallow /*?l=russian
Disallow /*?l=nederlands
Disallow /*?l=swedish
Disallow /*?l=korean
Disallow /*?l=french
Disallow /*?l=indonesian
Disallow /*?l=portuguese
Disallow /*?l=greek
Disallow /*?l=kurdish
Disallow /*?l=Taiwan
Disallow /*?l=magyar
Disallow /*?l=chinese
Disallow /*?l=polish
Disallow /*?l=spanish
Disallow /*?l=hebrew
Disallow /*?l=farsi
Disallow /*?l=turkey
Disallow /*?l=bulgarian
Disallow /*?l=Arabic
Disallow /*?l=brazilian
Disallow /*?l=slovensko
Disallow /*?l=italian
Disallow /*?l=srpski
Disallow /*?l=deutsch
Disallow /*%26mode%3Dsearch%28%26%7C%24%29
Disallow /search.php
Disallow /member.php
Disallow /register.php
Disallow /*.search.htm
Disallow /download.php
Disallow /*?image_id=
Disallow /*?sessionid=
Disallow /top.htm
Disallow /member.htm
Disallow /categories.php?cat_id=
Disallow /categories.htm?cat_id=
Disallow /details.php?image_id=
Disallow /details.htm?image_id=
Disallow /lightbox.php
Disallow /rss.php

mediapartners-google

Rule Path
Disallow

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gify.net/sitemap.xml

Comments

  • Google Image
  • BLOCK CERTAIN BOTS