The evolving Internet may encounter an explosion in the number of communicating end systems, namely, smart devices and wireless sensors. Machine-to-machine services in such a network could benefit society in many areas, including environment, health care, trade, transportation, alarms and surveillance. However, such developments depend on powerful communication features with global interoperability for service ubiquity. This paper presents an architecture for the evolving Internet that decouples service logic from protocols and network elements while shielding users from underlying technologies. It also proposes an ontology-based approach for representing network interoperability as well as network services. The network ontology provides a vocabulary for uniformly describing the managed elements of the network topology under consideration, while the service ontology provides an API-based vocabulary for provisioning interoperable and ubiquitous services over the Internet. Using these ontologies, services may be replicated and deployed in diverse execution environments. The applicability of ontologies for service ubiquity is illustrated with a case-study.