I just discovered this last night as well, so I wonder if this was implemented in one of the patches. I'm wrapping up the 2029 season and was ranked 2nd behind Oregon, which would be my 2nd top 5 class to unlock Elite Recruiter. With all the 5 star and 4 star players unavailable to me, I added 8 3-Star recruits to get up to the 35 limit. I did not offer them a scholarship. I had 4 of these recruits commit despite never offering them a scholarship. I could not remove them from my board because they committed to a non-existent offer. I ended up reverting to the version before I advanced the week and removed all of them from my board.
I would expect your QB to be there. The game responds as if you did offer him a scholarship. You can't offer, can't remove, can't allocate hours. The game views him as if he has committed to you.