Yes, you should be concerned, but don't panic. If it continues to rise, they should do some more scans to see what is happening. A probable response would be to modify the chemotherapy. Fortunately for us, there are a lot more options now than a few years ago.
My wife had a similar experience. (Stage 4 colon cancer.) She's doing better. We're hoping and praying for a cure.