Rimmer was named the players' player of the year after helping the Pirates to the RFU Championship final.
Having started his career at Earlsdon, the 26-year-old went on to play for Nuneaton and Coventry before making 90 appearances during three seasons at the Pirates.
And Exeter head coach Rob Baxter is looking for Rimmer to continue his development at Sandy Park after handing the front-rower a 12-month deal.
"With Carl's good form, being based at a local club and being the right age, the way he tested when we had a look at him, it made sense to go with him," Baxter told the club's official site.
"He's had a very good season, being players' player has proven that, but these later stages he's come through very strong and we think he's got the raw materials for us to work with.
"We're going to expect him to thrive and take every opportunity that comes along from being involved with a Premiership club, just like a lot of our guys who stepped up from the Championship with us.
"They have used the Premiership to improve themselves as players, they've used it to drive the way they've worked in the conditioning sessions, used it to drive the way they trained and played and it's moved them forward.
"That's important for him. He can't come to us and stand still, he needs to come to us and do what our other guys have done and not sit down and watch it happen around him.
"It's a good challenge for him but I think he's got all the raw materials so the ball's in his court. We'll obviously work very hard with him, but he's got to come here determined to make the step up."
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The entire All Blacks apparel line has been updated for 2013/14. Check out the New Zealand All Blacks polo.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Gilbert Blitz 8S rugby cleat is a great cleat at a great price of $69.99. Get a new pair of cleats today.
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
The All Blacks Performance t-shirt is black with hints of blue from the training jersey. Very Cool.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.