It's common for the intake cam journals to get a little haggard from lack of lubrication. The head biases oil to the exhaust side first, which is also the "downhill" cam that's mostly submerged in oil.
I like to run an external oil feed to the rear of the head, on the intake side. Super easy to do while the head is off.
Grab some 300-400grit sand paper and lightly sand the cap and journal. Clean it all up, and then lay the camshaft in the journals of the upper head section... with no caps on. How much can the cam rock when pushing the cyl1 side into the journal and then cyl4 side into the journal? Rotate the cam 90deg and repeat, rotate & rock, rotate & rock. How much rock was there? Is it consistent with the rotations? One side worse than the other? Stock cams aren't that straight in my experience, and can cause slight wear issues.