Twitxy Saved

philippe

Verified account This account is verified. Learn more

@philippepage

product & engineering
scaffold.inc | prev: @mainframe
Toronto philippe.page Joined September 2022
495 Following 790 Followers 602 Posts

Latest posts 5

Pinned post

philippe Verified account @philippepage
what does the process of building knowledge or developing experience look like for agents? in building an understanding of their world post-training

agents built this graph of context over a few weeks by reading new articles, pdfs, my own blog, watching youtube videos, talking with me, it represents the network of concepts, ideas, and people mentioned, as it read more articles, networks that were once separated began to connect into larger ones

model training covers most of the necessary awareness an agent needs, from realities of the world, facts in history, modes of thought, but it falls short of being able to understand much of ourselves

context shifts day to day, relationships change, even memories can shift in perspective at a later point. We meet people, our social network grows, we maintain conflicting information, and we can update previously held beliefs

agents should be able to build and maintain an orderly and accurate representation of their human's world in real-time, as they evolve and change. temporal understanding and evolution of memory are key to so much of what we consider intelligence

I imagine we'll see agents entering the valley of the uncanny in this sense, and perhaps what emerges will start surprising us again, pushing agents towards being something that can connect the dots behind the scenes, something that can see us, something capable of perception, of finding and integrating these insights, while maintaining perspective and awareness of the greater picture of the person they work with and represent
0:14
philippe Verified account @philippepage
under the hood Spaceship works by prompting, so i experimented with connecting the interface to the internals of a local model

the steering control adds to its activations, selected boxes shift actual attention, and the sidebar runs an unsteered copy to show where the two differ

spaceship-lime.vercel.app
0:22
philippe Verified account @philippepage 3d
one of the most brilliant takes i've seen as of late on HCI in the era of LLMs

Attention steering by Sun Chuanqi. Actually operating an LLM's attention and token generation. the concept, UX and sound design are just amazing. There are still so many unexplored patterns. this one's particularly inspiring

github.com/chuanqisun/spa…
View quoted post on X
2 replies 1 reposts 18 likes 722 views View on X