As you can clearly see, the average response time is 237ms which is really fast. You should be worried, if it crosses 1000ms mark on average.
According to Steve Souders in his book “High Performance Web Sites”, 80% of web page response time is in the content. Most of this time is spent dealing with the objects that make up a web page. As the number of objects per page increases beyond four, object overhead dominates total web page delay.
It is noticed that majority of the web pages exceeded well past this threshold, with more than 350 Kb in file size and many objects [almost above 20] in the webpage. If you can take these numbers to some descent level in your website, your page response time will definitely increase producing positive results for your SEO and user satisfaction.