During an appearance onJimmy Kimmel Live!Monday, theSuccessionactor joked of Depp, “I’ve heard a lot from his … they call it a fan club, but I think it’s some kind of CIA agency that works on his behalf.”

Cox, 75, said the paperback version of his book, when released in the U.K., will include an addendum he wrote, and hinted that it would touch onthe remarks he made about Depp, 58.

“I just thought Iwas being a bit harsh,” Cox said. “You know what it’s like — you go for the easy joke. And I went for the easy joke.”

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human-interest stories.

Brian Cox (L); Johnny Depp.Roy Rochlin/Getty; Jeff Spicer/Getty

Brian Cox Johnny Depp

In his memoir, Cox wrote of Depp in part, “Personable though I’m sure he is, [he] issooverblown,sooverrated.”

The actor admitted to hostJimmy Kimmelthat he “sort of regretted” what he wrote in the book about Depp, “because I’m not like that normally; I was just being a bit glib, a bit flip.”

When asked whether he believes actors generally think of themselves as overrated, Cox told Kimmel, 54, “I think they do. I think a lot of times actors think they’re overrated, and sometimes they think they’re underrated.”

“Let’s put it this way: Most of them think they’re not rated at all,” he added.

RELATED VIDEO: Meryl Streep Speaks Makes Emotional Speech: “I Am The Most Overrated Actress”

Cox, who has not worked with Depp, continued in his book, “I mean,Edward Scissorhands. Let’s face it, if you come on with hands like that and pale, scarred-face make-up, you don’t have to do anything. And he didn’t. And subsequently, he’s done even less.”

The Scottish actor turned down a role inPirates of the Caribbean, which Depp starred in, according to his memoir, perThe Big Issue.

TheSweeney Toddstar isn’t the only A-lister Cox wrote about. The veteran actor also shared his thoughts on directorQuentin Tarantino, writing, “I find his work meretricious. It’s all surface.”

“Plot mechanics in place of depth. Style where there should be substance,” he wrote, per The Big Issue. “I walked out ofPulp Fiction. That said, if the phone rang, I’d do it.”

source: people.com