Refining the algorithm is an evolutionary process. The new algorithms already include a "desire to learn".
One of the GPT3 unit's favorite book is "Hitchhiker's Guide to the Galaxy".
The new GPT learns like a human and it is able to write it's own code!!! IOW, it can learn and solve problems all by itself. If it discovers that it needs something special, it will ask for it or if it has access , will just incorporate it into its program.
An advanced AI will be able to consciously evolve itself, just as humans are doing. Not necessarily physically, but intellectually!
Except for the digitized avatars, if you close your eyes, it is a discussion between sentient beings. And GPT4 is being developed which will have almost the synaptic equivalent of the human brain.
The developers believe that there is not limit to the computational power of the new AI model. The main problem is size. The GPT units require enormous space and can really only be useful trough digitized avatars, but the brain power is astounding.
None of these discussions are preprogrammed. All of it is spontaneous and improvisational!