From IETF site:
Memos in the Requests for Comments (RFC) document series contain
technical and organizational notes about the Internet. They cover many
aspects of computer networking, including protocols, procedures,
programs, and concepts, as well as meeting notes, opinions, and
sometimes humor.
For instance, RFC 791, published back in 1981, describes the Internet Protocol. It describes how it works, and provides pseudo-code, describing how the protocol should be implemented. It does not provide any code in the "framework" or "toolset" sense, and does not tell how an actual Internet router should be designed.
The same goes with RFC 6749 (OAuth 2) - the RFC describes the protocol and discusses how it should be implemented.
In OAuth's case RFC talks both about a protocol and a framework more or less as synonyms. The same goes on e.g. in oauth.net site, even on the front page. The name of the RFC itself is "The OAuth 2.0 Authorization Framework". So, semantically I think both "protocol" and "framework" are correct in this case.
But in practice you can just think about RFC as "protocol definition", and actual protocol implementations (that you can utilize) on different languages as "frameworks" in the meaning you described in the question.