Gemini search engines and Yggdrasil
So I had a random thought:
Do any search engines exist that actually will crawl an Yggdrasil capsule?
That is, there's no doubt it's possible if they're on the network themselves, but none of the big ones I know seem to be, or say they are.
Mar 26 · 6 weeks ago · 👍 norayr, ps
16 Comments ↓
No, even catalogs.. I count only 2 capsules: mine (ps.ygg) and sava.rocks
📻 eugene [OP/mod] · Mar 27 at 09:37:
Actually, sava.rocks is on clearnet, and sava.ygg does not seem to be responding at all.
I figure search engines and catalogs are not worth the effort just yet, then. :)
🐙 norayr [mod] · Mar 27 at 20:56:
i am aware of:
📻 eugene [OP/mod] · Mar 27 at 21:00:
@norayr:
Of these, only լանա.հայ resolves to an Yggdrasil address, and it's also one that doesn't actually respond, at least to me...
Ah, here's why:
$ gg gemini://լանա.հայ
gg: handshake: name `լանա.հայ' not present in server certificate
🐙 norayr [mod] · Mar 28 at 00:47:
interesting, it responded to me at the time i was posting. can't check now, have no yggdrasil on sailfish. will write later.
🐙 norayr [mod] · Mar 28 at 00:48:
and another that should work with yggdrasil is
i can't open it now with clearnet so can't confirm.
📻 eugene [OP/mod] · Mar 28 at 05:25:
Unfortunately, `warloc.xpath.my` doesn't resolve at all, no matter which DNS system I ask.
Yggdrasil users prefer IPs as hosts, but there’s no server that supports them without SNI issues (gmid may be an exception). For ps.ygg I’m using Agate, but it still doesn’t support IP hosts, so I’m dependent on Alfis DNS.
About the search engines: uncompleted / abandoned attempt to make Manticore-based crawler:
— https://github.com/YGGverse/Yo/tree/gemini
Personally, I'm lazy to crawl the air; for me it's better to maintain the catalog as more energy effective.
And finally, the HTTP version of the Yo crawler had history snaps feature (e.g. web-archive) not sure about the Gemini branch but this option would be useful in areas where capsules not living for a while.
🐙 norayr [mod] · Mar 28 at 16:27:
i asked, փետուր was moved to
📻 eugene [OP/mod] · Mar 28 at 17:00:
gemini://իւ.փետուր.հայ/ resolves to an Yggdrasil address, but still doesn't respond, just keeps hanging there indefinitely...
🐙 norayr [mod] · Mar 28 at 20:00:
@eugene both are showing fine fore me. just checked.
btw try to open
🐙 norayr [mod] · Mar 28 at 20:03:
we were experimenting recently with the folks of yggdrasil xmpp muc, and many set up an xmpp server on yggdrasil. even without a canonical dns record, but with domain names inferred from yggdrasil ip address.
see my post about s2s_meshv6alt
📻 eugene [OP/mod] · Mar 28 at 21:09:
norayr.am opens, though I'm not sure if it's over Yggdrasil or directly, because it has an ipv4 clearnet address too. I set Lagrange to prefer ipv6, and it still opened, which presumably means it opened the Yggdrasil ip... Forcing `gg` to open the IPv6 end with `/etc/hosts` worked, so yeah, it's reachable.
I'm pretty sure it's not my Yggdrasil setup as such, I use Yggdrasil internally very heavily. Both of the Armenian domain names respond properly when I turn off SOCKS. Which I have to keep turned on for other reasons. Guess I need to muck about to make sure the `200::` get routed correctly *after* getting resolved too.
but with domain names inferred from yggdrasil ip address.
...Yeah, meship/meshnamed are also an option...
🐙 norayr [mod] · Mar 28 at 23:52:
to tell more about the mentioned solution, it all started with
i wrote
unlike yggns or meshname, where encoded IP usually identifies the node that is authoritative for a zone, and that node runs regular DNS for its namespace, in our rn + v6.alt scheme, the encoded name itself already contains the target IPv6 address, so the resolution is much more direct.
i guess i need to make a forum post about it.
🐙 norayr [mod] · Mar 29 at 00:23:
back to topic, maybe it worth to ask @acidus to also crawl yggdrasil gemini capsules, and in search results mark somehow that the link is from yggdrasil, not clearnet.
📻 eugene [OP/mod] · Mar 29 at 03:49:
I'm considering putting an Antenna in the Yggdrasil tree myself, actually... 😉 There aren't enough nodes to make searching them and marking the results worth it, IMHO, but an aggregator just for them is easy.