Discussion:
New Usenet map, based on 8 april data (PNG and PDF)
(too old to reply)
U.ee
2020-04-10 22:29:23 UTC
Permalink
Hello!


I am still struggling with massive node count, cairo don't like it.
In moment there should be ca 600 nodes, down from previous 8000 something.
Loading Image...

PDF version has little bit more stuff going on, lower half has fido cluster.
http://usenet.ee/maps/graph3-n-20200408.pdf

I have lot of ideas, but not enough time :)

Best regards
U.ee
yamo'
2020-04-11 07:38:28 UTC
Permalink
Hi,
Post by U.ee
Hello!
I am still struggling with massive node count, cairo don't like it.
In moment there should be ca 600 nodes, down from previous 8000 something.
http://usenet.ee/maps/graph-n-cleaned-20200408.png
PDF version has little bit more stuff going on, lower half has fido cluster.
http://usenet.ee/maps/graph3-n-20200408.pdf
I have lot of ideas, but not enough time :)
Best regards
U.ee
Great job!
--
Stéphane
The Doctor
2020-04-11 12:41:57 UTC
Permalink
Post by yamo'
Hi,
Post by U.ee
Hello!
I am still struggling with massive node count, cairo don't like it.
In moment there should be ca 600 nodes, down from previous 8000 something.
http://usenet.ee/maps/graph-n-cleaned-20200408.png
PDF version has little bit more stuff going on, lower half has fido cluster.
http://usenet.ee/maps/graph3-n-20200408.pdf
I have lot of ideas, but not enough time :)
Best regards
U.ee
Great job!
--
Stéphane
Well done. I need to see if news.nk.ca is correctly represented.
--
Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca
Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising!
https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on Atheism
Those who cannot win on facts rely upon slander. -unknown
Neodome Admin
2020-04-15 00:21:24 UTC
Permalink
Post by U.ee
PDF version has little bit more stuff going on, lower half has fido cluster.
http://usenet.ee/maps/graph3-n-20200408.pdf
I’m surprised to see that Fido have only one gateway to Usenet.
Post by U.ee
I have lot of ideas, but not enough time :)
Good work, thank you. Definitely was interesting to take a look. Are you
planning to make these maps regularly, using a script?

When you’re generating a map, are you also using articles rejected by
cleanfeed or only the ones that are going to be stored on the server?
--
Neodome
U.ee
2020-04-15 16:18:47 UTC
Permalink
Guten Tag!
Post by Neodome Admin
Post by U.ee
PDF version has little bit more stuff going on, lower half has fido cluster.
http://usenet.ee/maps/graph3-n-20200408.pdf
I’m surprised to see that Fido have only one gateway to Usenet.
There are two paths, put seems that one got filtered out. They map fido
part differently though.
Gateways seem to be ddt.demos.su and news.dewy.ru.
Post by Neodome Admin
Post by U.ee
I have lot of ideas, but not enough time :)
Good work, thank you. Definitely was interesting to take a look. Are you
planning to make these maps regularly, using a script?
Thanks! I thought that (regular and automated maps), when I started.
Now, seems that there is few challenges, map visual optimization for
example. There are tools I haven't yet explored. Julien pointed out few
tools to collecting/modifying data, so maybe those help with less IO
intensive data manipulation.
Post by Neodome Admin
When you’re generating a map, are you also using articles rejected by
cleanfeed or only the ones that are going to be stored on the server?
Using only stored articles. I did little comparison and indeed: some
sites are indeed only represented in cleanfeed rejected feed.
I don't know right now, what to do with them, probably should be
included next time.
Then again, my mai problem is huge node count, usenet is too big :)


Best regards and thanks for writing!
U.ee
Neodome Admin
2020-04-16 00:24:50 UTC
Permalink
Post by U.ee
Using only stored articles. I did little comparison and indeed: some
sites are indeed only represented in cleanfeed rejected feed.
I don't know right now, what to do with them, probably should be
included next time.
There’s a similar project, Top1000. Not sure if you are aware of it.

<http://top1000.anthologeek.net>

It collects data from participants and tries to create a graph of Usenet
distribution per site.

It’s interesting that I see some sites in your data that don’t appear in
their lists. I participate in that project and I remember seeing sites
popping up with only one or two messages sent from them. Perhaps some
glitch.
Post by U.ee
Then again, my mai problem is huge node count, usenet is too big :)
Just need more collaboration between sites to be able to fold bunch of
nodes in one. Many of them are actually virtual nodes, i.e. just another
names for the same server.

When you’re trying to create more readable map, is it possible to change
the thickness of connecting lines representing approximate amount of
articles flowing from one site to another?
--
Neodome
U.ee
2020-04-17 16:09:56 UTC
Permalink
Post by Neodome Admin
Post by U.ee
Using only stored articles. I did little comparison and indeed: some
sites are indeed only represented in cleanfeed rejected feed.
I don't know right now, what to do with them, probably should be
included next time.
There’s a similar project, Top1000. Not sure if you are aware of it.
<http://top1000.anthologeek.net>
It collects data from participants and tries to create a graph of Usenet
distribution per site.
It is well known project, put I don't think there is overlapping.
Post by Neodome Admin
It’s interesting that I see some sites in your data that don’t appear in
their lists. I participate in that project and I remember seeing sites
popping up with only one or two messages sent from them. Perhaps some
glitch.
Post by U.ee
Then again, my mai problem is huge node count, usenet is too big :)
Just need more collaboration between sites to be able to fold bunch of
nodes in one. Many of them are actually virtual nodes, i.e. just another
names for the same server.
If you follow some earlier messages, we had discussion with Grant Taylor
about that.
Post by Neodome Admin
When you’re trying to create more readable map, is it possible to change
the thickness of connecting lines representing approximate amount of
articles flowing from one site to another?
That is interesting idea, but that is place, where Top1000 should be
relevant:)
I am afraid that this isn't viable with only one collecting site.
With peering relations, things are easier: I see one path containing
specific relations and that is good enough, even when 1000 other paths
are different.
With article count though, things are heavily depending on my peering
relations.
I can't use top1000 public data either, they show generic article count
per site, there isn't peering information.



Best regards
U.ee
Julien ÉLIE
2020-04-19 07:09:19 UTC
Permalink
Hi all,
Post by Neodome Admin
There’s a similar project, Top1000. Not sure if you are aware of it.
<http://top1000.anthologeek.net>
It collects data from participants and tries to create a graph of Usenet
distribution per site.
Only 85 participants in March 2020...
We used to be more than 300 in 2004-2010. Sigh.
--
Julien ÉLIE

« En fait, je n'ai qu'une prétention, c'est de ne pas plaire à tout
le monde. Plaire à tout le monde, c'est plaire à n'importe qui. »
(Sacha Guitry)
Loading...