Re^4: RFC: Peer to Peer Conceptual Search Engine

Your "conceptual indexing" sounds a lot like what's today called "social bookmarking", which tries to apply a similiar process to webpages as used in libraries. The Wikipedia page has a section "Comparison with search engines".

The Wiser.org Search API probably was derived from (or the same as) the WiserEarth API, which (still) is in the Internet Archive (FAQ and Documentation)

I don't think there's active scrubbing going on, the "normal" entropic force is strong enough already, especially if the information in question needs active maintenance.

Comment on Re^4: RFC: Peer to Peer Conceptual Search Engine

Replies are listed 'Best First'.
Re^5: RFC: Peer to Peer Conceptual Search Engine by PerlGuy(Tom) (Acolyte) on Jan 30, 2020 at 11:38 UTC
I misspoke. What I meant was the open source WiserEarth platform. The program(s) that ran the site. The backend rather than the frontend. I did just find it on SourceForge,(I think, looks like?). https://sourceforge.net/projects/wiserplatform/files/wiserplatform/ There are, I suppose, some parallels between my program, or indexing system and social bookmarking, but social bookmarking, in practice, requires, generally speaking, some proprietary methodology on some specific platform with an inaccessible database. Delicious has gone by the wayside somewhere after passing through different hands. Along with it went 180 million bookmarks. Presumably, that will happen sooner or later with every such proprietary service or "black box" type database on the internet. What is needed IMO is an internet standard, similar to the Dewey Decimal System for books, in public libraries Read more... (2 kB) What I've endevored to produce is something more along the lines of Ranganathan's "colon classification system". https://en.m.wikipedia.org/wiki/Faceted_classification Such a faceted metadata structure is compact, concise yet comprehensive, sufficiently flexible and extensible to encompass everything on the internet for the foreseeable future, yet structured enough to be computer readable. i.e. it can be easily and reliably isolated from whatever else appears in the source code of a website (using regular expressions). Tom	[reply]
Re^6: RFC: Peer to Peer Conceptual Search Engine by PerlGuy(Tom) (Acolyte) on Jan 30, 2020 at 18:24 UTC
Significant, from the Wikipedia article is this example of Ranganathan's metadata compacting method: Read more... (1282 Bytes) All that becomes this: L,45;421:6;253:f.44'N5 The particular concepts incorporated into the example are not particularly relevant to internet indexing. Factually, I would say that only three facets are represented; Topic (hierarchically structured), Location (think geocodeing. Google Earth), and Time (Think, event calendar data, scheduled future events included). We can dispense with delimiters, if the pattern structure remains consistent. This style of encoding data could incorporate any number of facets. What else might be included? I've incorporated those I consider important and useful in the program, but it isn't written in stone. Tom	[reply]


Perl Monk, Perl Meditation
	PerlMonks