My modem and my router are both separate units that I purchased out right as I di not want to be on a 'rental basis' with Comcast (my internet provider.).
Smart move, IMO. I bought my own and recommend others do the same.
I also thought I might have equip that might be a little superior to that provided by the internet company.
Years ago that was true. But today the ISPs have learned it makes sense to invest in better quality products that more of their users will be willing to rent as it pays off (big time!) in the long run.
Also, many providers use that rental equipment for sharing wifi for their traveling customers. Even though it is additional bandwidth we do not pay for, and while there is no evidence these "guests" can gain access to our own networks, I don't like the idea of strangers using my networking gear (or electricity). So that's another reason to buy your own. But that's for another discussion.
As far as your network gear, before spending any money, the first thing you should do is replace the Ethernet cable between your router and modem. These very simple, low tech "network devices" are critical for optimal network performance. But they are not robust at all. The factory made Ethernet cables are often cheap in every sense of the word. Because they are so inexpensive to make, little to no quality control is implemented so it is not uncommon for them to be faulty right out of the factory.
Still, even best can easily be damaged as they can only survive being yanked on or tripped over so many times (often not even once).
I always make my own cables but that does take an "investment" in a quality crimping tool. I probably wasted $50 on cheap crimpers before paying $40+ for a quality tool that has served me exceptionally well for over 20 years. Making quality cables also takes good RJ-45 connectors, good eyes, good lighting, steady hands and practice as you sacrifice several connectors and feet of cable building cables. Still, if you make lots of cables (I wired my home), buying a quality crimping tool and cable tester, and buying cable and connectors in bulk to make your own is cheaper in the end compared to buying factory made cables.
While not essential, a decent Ethernet cable tester is extremely time saving and helpful as it clearly reduces blood pressure and hair loss!
The bonus with making your own cables is you can make them the length you need. For example, 12-18 inches likely all you need between your modem and router. You don't need a 6ft cable. And if it is 13 feet from your router to your computer, you don't need to buy a 25ft cable.
If making your own does not seem worthwhile, make sure you have spare cables of different lengths handy just for events like this. A damaged $2 cable may be causing all your headaches. Check this out. At that price, I would buy several - in case one is bad from the factory. That source also has cables in 2 and 3 foot lengths (if 1ft is too short) and various colors. Using different color cables between devices is nice for good cable management and when troubleshooting.
I had read that there existed 'firmware' that could be updated in these routers, and investigated that (although I have no idea how to do it).
I explained how to do it in my last post.