NISHIO Hirokazu[English][日本語]

pConceptMap2025-09-09

pConceptMap

I had been experimenting with a script in a plurality repo, but I decided that it would be better to use an independent repo for release, like Vercel, so I cleaned up the mess.

Currently, prototypes are created by replacing HTML files, but we want to create them with something like React to make the UI improvement cycle more efficient. I want to eventually export and release static HTML.

Try git worktree

Improvements to prompts.py

  • "tier": "core"|"supplementary"|"advanced" This should be deleted.
    • Create a tier by extracting different max_concepts in the future.
  • Allowed relation types (choose one): {relation_types} also remove this limitation
    • Relationships are expressed in short sentences that include the subject

image

Bug that parallelism is reset when clicking on a node after a parallel move.

The "relation" is now a sentence, but we would like to rename it to the field name "relation_description" and put a short expression of one word, or at most three words, in the "relation" field if possible. The reason for this is to display it as an edge label when drawing the graph.

  • image

It's not a good view if the quote contains ***, but should I leave it to see where it appears?

  • Is there a way to simply make the display part of the WebUI a Markdown component?

When you click on a relation label, it would be nice if information about that relation (citation, etc.) would appear below the node information that is currently displayed.

  • image

imageimage

Let's make sure that concepts and relationships detailed in the cards are highlighted in the graph on the left.

image image

I'd love to get it into a state where others can touch it today.

  • Maybe GitHub Actions to generate static and GitHub Pages.
  • Well, once you do, you can do it manually.
    • And when I say manual, I mean AI hands.

I want to use this for a single book manuscript that has "multiple chapter files with multiple sections within them".

  • I think simply displaying the whole thing would be impactful but not user friendly.
  • Let's make a plan of what to do.

AI created a whole section integration on its own, but it still didn't work.

  • image

When a node is dragged and released, it is pinned and its position is fixed.

It seems like a good idea to pass the graph to GPT5 to find the occurrence of keywords across chapters

  • That is, important concepts that are discussed in multiple chapters.

There are patterns in the individual chapter graphs that are not consolidated.

  • That it is not enough because 10 concepts are extracted out of the decision.
  • Maybe we could do a separate one to help them find the concepts that connect the in-between.

It would be interesting to be able to extract references that cross chapters as well.


All data completed.

  • $1

Claude.icon ⏺ Behavior during long chapter data processing 1. automatic truncation at 12,000 characters (pipeline.py:151, line 177) - When sending to LLM, process only the first 12,000 characters in sec.text[:12000 - The rest of the text is ignored.

Critical Problem Found:.

  1. 2-0-IT and Democracy The Enlarging Divide.md
  • Section 9: 25,515 characters → 53% lost
  1. 3-3-the lost road.md
  • Section 10: 16,308 characters → 26% lost More than half of the important content (in the case of 2-0) is not processed in these sections. Simple truncation by sec.text[:12000]. The first time the text is used, context and important information may be lost.

I thought this was a great problem, but it's just a bunch of footnotes at the end of the page.nishio.icon


Work to convert non-linked chapters into linkages - associative connection That's the one.

image It's done. image It's been successfully repaired.

Version not an isolated point image image I see, you inserted "online version" between "get the latest version" and "non-linear reading and hyperlinks".

By the way, I've created a tool to generate a prompt with all the necessary information, and I'm throwing it to ChatGPT 5 Thinking.

image

I wonder if we can do this with the 5-mini.

  • But I don't think it's necessary to implement it because I can just throw a few cases as I look at them.
  • "The 4-3 bridging concept is 'checks'."
    • interesting

image

  • Add SNS node and connect

image

  • I'm looking forward to seeing how this works out.
  • The proposal is to add a minimum of 3 bridging concepts to fill the lack of linkage, and all nodes are merged into one main linkage component with 12 edges.

  • image
  • Connected!

pConceptMap2025-09-10


This page is auto-translated from /nishio/pConceptMap2025-09-09 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.


(C)NISHIO Hirokazu / Converted from Markdown (en)
Source: [GitHub] / [Scrapbox]