copium comments will continue until a robot can change a duvet cover
anthropic have closed the loop internally and achieved asi. we made it.View quoted post on X
@mayfer
anthropic have closed the loop internally and achieved asi. we made it.View quoted post on X
continuous online learning likely requires abstractions to be very clean and deduped in the latent space. what if there was a loss function to encourage low rank representations to avoid having duplicates in the weights?View quoted post on X
imo e2e mechanistic interpretability has the highest chance of leading to e2e memory recall by providing activation-triggered indexing and searchView quoted post on X
i built an embedding engine by composing vectors from common abstraction neuron activations (h/t @nickcammarata "already clean" essay)View quoted post on X
and it behaves more consistently especially when doing embedding math. less distracted by spelling/formatting and more focus on abstractions present
it's not always better, but generally at least on par. i have not seen it breakdown into returning junk like regular embedding models do yet. i am gonna try running some vector search evals on it to see how it performs