Instance Segmentation for Governmental Inspection of Small Touristic Infrastructure in Beach Zones Using Multispectral High-Resolution WorldView-3 Imagery

Misappropriation of public lands is an ongoing government concern. In Brazil, the beach zone is public property, but many private establishments use it for economic purposes, requiring constant inspection. Among the undue targets, the individual mapping of straw beach umbrellas (SBUs) attached to the sand is a great challenge due to their small size, high presence, and agglutinated appearance. This study aims to automatically detect and count SBUs on public beaches using high-resolution images and instance segmentation, obtaining pixel-wise semantic information and individual object detection. This study is the first instance segmentation application on coastal areas and the first using WorldView-3 (WV-3) images. We used the Mask-RCNN with some modifications: (a) multispectral input for the WorldView3 imagery (eight channels), (b) improved the sliding window algorithm for large image classification, and (c) comparison of different image resizing ratios to improve small object detection since the SBUs are small objects (<322 pixels) even using high-resolution images (31 cm). The accuracy analysis used standard COCO metrics considering the original image and three scale ratios (2×, 4×, and 8× resolution increase). The average precision (AP) results increased proportionally to the image resolution: 30.49% (original image), 48.24% (2×), 53.45% (4×), and 58.11% (8×). The 8× model presented 94% AP50, classifying nearly all SBUs correctly. Moreover, the improved sliding window approach enables the classification of large areas providing automatic counting and estimating the size of the objects, proving to be effective for inspecting large coastal areas and providing insightful information for public managers. This remote sensing application impacts the inspection cost, tribute, and environmental conditions.

Resolving the time course of visual and auditory object categorization

Humans can effortlessly categorize objects, both when they are conveyed through visual images and spoken words. To resolve the neural correlates of object categorization, studies have so far primarily focused on the visual modality. It is therefore still unclear how the brain extracts categorical information from auditory signals. In the current study we used EEG (N=47) and time-resolved multivariate pattern analysis to investigate (1) the time course with which object category information emerges in the auditory modality and (2) how the representational transition from individual object identification to category representation compares between the auditory modality and the visual modality. Our results show that (1) that auditory object category representations can be reliably extracted from EEG signals and (2) a similar representational transition occurs in the visual and auditory modalities, where an initial representation at the individual-object level is followed by a subsequent representation of the objects category membership. Altogether, our results suggest an analogous hierarchy of information processing across sensory channels. However, we did not find evidence for a shared supra-modal code, suggesting that the contents of the different sensory hierarchies are ultimately modality-unique.

What is Matter in Aristotle's Hylomorphism?

Aristotle's notion of matter has been seen either as unintelligible, it being some mysterious potential entity that is nothing in its own right, or as simply the notion of an everyday object. The latter is the common assumption in contemporary approaches to hylomorphism, but as has been pointed out, especially by scholars with a background in ancient philosophy, if we conceive of matter as an object itself we cannot account for the unity of hylomorphic substances. Thus, they assume that a hylomorphic substance is an essential unity and matter not a constituent at all. This solution to the problem of unity, however, brings us back to the mysterious notion of matter. For these reasons, I will revisit Aristotle's conception of matter in this paper. I will argue that an understanding of form as a cause of being requires that matter be an independent constituent of the individual substance. However, I agree that the conception of matter as an individual object with an essence makes it impossible to solve the problem of unity. We therefore need to take seriously Aristotle's assertion that matter is nothing in its own right and not an individual. By denying that matter is an individual, Aristotle does not introduce a mysterious entity, nor does he deny that it can be identified independently of the whole; instead, matter for Aristotle is an irreducible plurality, and this explains why it is not an individual and has no essence. I will conclude with some observations on how this gives rise to two competing versions of hylomorphic constitution.

Recognition of natural objects in the archerfish

Recognition of individual objects and their categorization is a complex computational task. Nevertheless, visual systems are able to perform this task in a rapid and accurate manner. Humans and other animals can efficiently recognize objects despite countless variations in their projection on the retina due to different viewing angles, distance, illumination conditions, and other parameters. Numerous studies conducted in mammals have associated the recognition process with cortical activity. Although the ability to recognize objects is not limited to mammals and has been well-documented in other vertebrates that lack a cortex, the mechanism remains elusive. To address this gap, we explored object recognition in the archerfish, which lack a fully developed cortex. Archerfish hunt by shooting a jet of water at aerial targets. We leveraged this unique skill to monitor visual behavior in archerfish by presenting fish with a set of images on a computer screen above the water tank and observing the behavioral response. This methodology served to characterize the ability of the archerfish to perform ecologically relevant recognition of natural objects. We found that archerfish can recognize an individual object presented under different conditions and that they can also categorize novel objects into known categories. Manipulating features of these objects revealed that the fish were more sensitive to object contours than texture and that a small number of features was sufficient for categorization. Our findings suggest the existence of a complex visual process in the archerfish visual system that enables object recognition and categorization.

Serial dependence tracks objects and scenes independently

The visual world is made up of objects and scenes. Object perception requires both discriminating an individual object from others and binding together different perceptual samples of that object across time. Such binding manifests by serial dependence, the attraction of the current perception of a visual attribute towards values of that attribute seen in the recent past. Scene perception is subserved by global mechanisms like ensemble perception, the rapid extraction of the average feature value of a group of objects. The current study examined to what extent the perception of single objects in multi-object scenes depended on previous feature values of that object, or on the average previous attribute of all objects in the scene. Results show that serial dependence occurs independently on two simultaneously present objects, that ensemble perception depends on previous ensembles, and that serial dependence of an individual object occurs only on the features of that particular object. These results suggest that the temporal integration of successive perceptual samples operates simultaneously at independent levels of visual processing.

The Visual Power of Photography and Its Status as a Representation

I shall introduce a hermeneutic perspective and photography analyses from visual theory to the debate concerning the status of photographic representation (together with film, as it is based on the photographic method) which continues within Anglo-Saxon aesthetics and analytical aesthetics. I mostly confront Roger Scruton and Gregory Currie’s thoughts on the photograph and its object (source), representation-by-origin and representation-by-use with Gottfried Boehm’s concept of aesthetic nondifferentiation, and Georges Didi-Huberman’s analyses of photographs. This shall allow me to identify the two aspects of photography (independence of an individual object and visual dynamics of an image) which have a significant impact on the status of photography as a representation and on the potential of cinematographic creation as a story told through images.

Red Collections in Contemporary China

“Red Collecting” is a widespread phenomenon in contemporary China. It refers to the collecting of objects from the Chinese Communist Party’s history. Red Collecting has received only minimal treatment in English-language scholarly literature, much of which focuses on individual object categories (primarily propaganda posters and Chairman Mao badges) and overemphasises the importance of Cultural Revolution objects within the field. Because of this limited focus, the collectors’ motivations have been similarly circumscribed, described primarily in terms of either neo-Maoist nostalgia or the pursuit of profit. This article will seek to enhance this existing literature and, in doing so, offer a series of new directions for research. It makes two main arguments. First, that the breadth of objects incorporated within the field of Red Collecting is far broader than current literature has acknowledged. In particular, the importance of revolutionary-era (pre-1949) collections, as well as regional and rural collections is highlighted. Second, it argues that collectors are driven by a much broader range of motivations, including a variety of both individual and social motivations. Significantly, it is argued that collectors’ intentions and their understandings of the past do not always align; rather, very different understandings of China’s recent past find expression through Red Collecting. As such, it is suggested that Red Collecting constitutes an important part of contemporary China’s “red legacies,” one which highlights the diversity of memories and narratives of both the Mao era and the revolutionary period. Image © Hou Feng

Radar Voxel Fusion for 3D Object Detection

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive perception systems cannot be tailored to a narrow field of specific tasks but must handle an ever-changing environment with unforeseen events. As currently no single sensor is able to reliably perceive all relevant activity in the surroundings, sensor data fusion is applied to perceive as much information as possible. Data fusion of different sensors and sensor modalities on a low abstraction level enables the compensation of sensor weaknesses and misdetections among the sensors before the information-rich sensor data are compressed and thereby information is lost after a sensor-individual object detection. This paper develops a low-level sensor fusion network for 3D object detection, which fuses lidar, camera, and radar data. The fusion network is trained and evaluated on the nuScenes data set. On the test set, fusion of radar data increases the resulting AP (Average Precision) detection score by about 5.1% in comparison to the baseline lidar network. The radar sensor fusion proves especially beneficial in inclement conditions such as rain and night scenes. Fusing additional camera data contributes positively only in conjunction with the radar fusion, which shows that interdependencies of the sensors are important for the detection result. Additionally, the paper proposes a novel loss to handle the discontinuity of a simple yaw representation for object detection. Our updated loss increases the detection and orientation estimation performance for all sensor input configurations. The code for this research has been made available on GitHub.

Hacking Architecture: Re-envisioning Architecture Typology

The city is in flux. The future of living and working in city are changing. A large amount of urban fabric is changing to conciliate our needs for the future. The question is, is a new building necessary? Currently, there are large amounts of underutilized urban building stocks that can be transformed into something new to accommodate our future needs for the city. The future of building is not about creating an individual object, but rather deals with socio-cultural activities that redefine city living. This thesis will be looking at how to deal with existing building and envisioning a new building typology by using the idea of hacking. Following the logic of hackers, everything is hackable; when hackers hack into computer systems, they produce new things by altering original sources. The idea of hacking is introduced as a means of research method to modifying the features of a system and organizational tools to find a new relationship.

Hacking Architecture: Re-envisioning Architecture Typology

The city is in flux. The future of living and working in city are changing. A large amount of urban fabric is changing to conciliate our needs for the future. The question is, is a new building necessary? Currently, there are large amounts of underutilized urban building stocks that can be transformed into something new to accommodate our future needs for the city. The future of building is not about creating an individual object, but rather deals with socio-cultural activities that redefine city living. This thesis will be looking at how to deal with existing building and envisioning a new building typology by using the idea of hacking. Following the logic of hackers, everything is hackable; when hackers hack into computer systems, they produce new things by altering original sources. The idea of hacking is introduced as a means of research method to modifying the features of a system and organizational tools to find a new relationship.