Comment by ๐Ÿ’Ž istvan

Re: "Search Engines in Gemini"

In: s/Gemini

I think it may have been due to my robots.txt, which was there in an attempt to stop the content from being hit by web crawlers if someone linked to a document over a Gemini to Web proxy.

My attempt to block spiders from caching may have blocked Kennedy from indexing.

๐Ÿ’Ž istvan

2024-09-03 ยท 2 years ago

Original Post

๐ŸŒ’ s/Gemini

โ˜•๏ธ Aptor-theHobbit:

Search Engines in Gemini โ€” I found out that when I search for my capsule on any of the search engines on Gemini, nothing comes up? I tried adding its url in Kennedy as well, few times, still nothing. Its weird since, the crawlers should be working just fine since I do not even have robot.txt in my main path of the capsule. Did anyone else has experienced this before? Its been more than 10 days since I launched my capsule. I hope it shows up in the search at least, just in case someone is cuious...

๐Ÿ’ฌ 7 comments ยท 2024-09-02 ยท 2 years ago ยท #capsule #search_engines