Skip to main content

Applying fork/join model and git-style cherry picking to AI conversations

In this post we introduce using the fork/join concurrency pattern combined with the git-style cherry picking to manage and use LLM conversations.  

These are loose conceptual connections, so please put down the pitchfork (pun intended).

Just as in git you can cherry-pick a commit from one branch to create a new head on another branch, you can pick conversations across sessions (including between different models) to build context to drive LLM conversations.

You can also create a fork of a session, this creates a parallel set of messages that are detached from, ie forked off the main session within which they run.

You can create new messages that join an existing fork.

This is a nice capability, the degree to which it will prove useful is yet to be determined. One of the possibilities is giving the user an ability to create long term "memory" from AI conversations and being able to easily reuse that memory (set of messages) without the need to rebuild context.

The ability to label forks is especially helpful in letting user know what the fork represents and thus offers the potential of greater utility. Below is a demo of this feature:

 


 

Comments

Popular posts from this blog

Workflow Automation: Letting AI Write Workflow Code

Workflow automation is one those perennial technology efficiency promises that has never quite delivered but never goes away.  The appeal of the idea is obvious, being able to easily direct computers to perform process tasks without deep technical expertise is the holy grail of the promise of computers. The excitement around AI agents is the latest incarnation of this promise. Workflow automation can be implemented in many forms, the most common is some sort of visual composition approach. Drag-n-drop workflow builders for instance are quite common. The fundamental problem that workflow automation has faced is that it attempts to allow non-programmers to...well, program. This is a fundamental contradiction that always reveals itself once one tries to use these products to do anything beyond the demo reel. More recent takes on the idea have taken on the problem with a hybrid approach, ie code when you need it and UI when you don't,...this is the literal tagline that the popular work...

AI Agents: Human Synthesis vs Human Substitutes

Human synthesis vs human substitute , this appears to be the two core perspectives for accessing AI when it comes to agentic execution.  From a human synthesis perspective, you observe that for the first time we have broad computational access to what were previously uniquely human capabilities. At the moment this can be enumerated as the ability to speak , see , hear and understand information . When hominoid robotics are mature enough, we can add the ability to use limbs to this synthesis. Prior to the emergence of LLMs, if you had a process that required any one of these capabilities, you needed to plug a human into the loop. It didn't matter whether the human had any particular expertise or not, if you needed to know what's in a picture or what someone said, you needed a person integrated into your process.  LLM/AI have changed this, we now have computational access to what I would describe as human synthesis . This is different from human substitute , which is what ...

The feds need to shutdown the bitcoin scam now.

I live in Baltimore, let's say I have some hypothetical friends who are always looking for a good hustle. Now imagine if my friends got together for a new get-rich-quick-scheme, the scheme is very simple. They invent something called cracken (bitcoins) that they start selling on a few blocks in Hamsterdam . The way you get crackens is to do laps around the blocks in Hamsterdam . Initially when the scheme was setup, you could get a whole lot of crackens by merely doing a few strolls around the block. Needless to say my friends made out like bandits, since, after all they created the scheme and could take advantage of the first-come-first-serve rules. Unfortunately for the rest of the hood, the number of laps required to get the same number of crackens keeps going up and after a while even the fittest folks in the neighborhood cannot do the lapse required to earn crackens. Cracken mania takes hold and infects the whole city. Those with crackens start trading these crackens f...